-- Logs begin at Wed 2022-07-20 18:36:23 UTC, end at Wed 2022-07-20 19:43:04 UTC. -- Jul 20 19:09:54.511004 dv-cinder-850548-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 19:09:54.520278 dv-cinder-850548-1-smb devstack@keystone.service[80308]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:09:54 2022] *** Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: nodename: dv-cinder-850548-1-smb Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: machine: x86_64 Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: clock source: unix Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: pcre jit disabled Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: detected number of CPU cores: 4 Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: current working directory: / Jul 20 19:09:54.522313 dv-cinder-850548-1-smb devstack@keystone.service[80308]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: your processes number limit is 47680 Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: your memory page size is 4096 bytes Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: detected max file descriptor number: 2048 Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: lock engine: pthread robust mutexes Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: thunder lock: enabled Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 19:09:54.522927 dv-cinder-850548-1-smb devstack@keystone.service[80308]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:09:54.566741 dv-cinder-850548-1-smb devstack@keystone.service[80308]: Python main interpreter initialized at 0x5582496579c0 Jul 20 19:09:54.566741 dv-cinder-850548-1-smb devstack@keystone.service[80308]: python threads support enabled Jul 20 19:09:54.566741 dv-cinder-850548-1-smb devstack@keystone.service[80308]: your server socket listen backlog is limited to 100 connections Jul 20 19:09:54.566741 dv-cinder-850548-1-smb devstack@keystone.service[80308]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:09:54.567123 dv-cinder-850548-1-smb devstack@keystone.service[80308]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:09:54.567192 dv-cinder-850548-1-smb devstack@keystone.service[80308]: *** Operational MODE: preforking *** Jul 20 19:09:54.567489 dv-cinder-850548-1-smb devstack@keystone.service[80308]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:09:54.567489 dv-cinder-850548-1-smb devstack@keystone.service[80308]: spawned uWSGI master process (pid: 80308) Jul 20 19:09:54.567746 dv-cinder-850548-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 19:09:54.571153 dv-cinder-850548-1-smb devstack@keystone.service[80308]: spawned uWSGI worker 1 (pid: 80318, cores: 1) Jul 20 19:09:54.571153 dv-cinder-850548-1-smb devstack@keystone.service[80308]: spawned uWSGI worker 2 (pid: 80319, cores: 1) Jul 20 19:09:54.571153 dv-cinder-850548-1-smb devstack@keystone.service[80308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:09:59.967389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:59.967389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Jul 20 19:09:59.968236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:59.968236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Jul 20 19:09:59.992023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:59.992023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Jul 20 19:09:59.992663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:59.992663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Jul 20 19:10:00.017211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:10:00.017400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:10:00.017547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] command line args: [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:10:00.017851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:10:00.018049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ================================================================================ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:10:00.018259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.018560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] config_dir = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.018773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.018919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] config_source = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.019134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] debug = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.019329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.020901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_config_append = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.021171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.021331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_dir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.021543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.021790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.022045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.022303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.022544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.022692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.022866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.023132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.023364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.023598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.023836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.024081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.024320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.024657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.024969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.025247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.025756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.025934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] publish_errors = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.026668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.026668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.026668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.026873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.026978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.027206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] standard_threads = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.027459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.027697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.027871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.028043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] use_journal = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.028214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] use_json = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.028385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] use_stderr = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.028588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] use_syslog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.028814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.029068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.029299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.029554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.029787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.030195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.030294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.030493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.030752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.030960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.031199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.031471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.031703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.031943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.032170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.032409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.032655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.032883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.033132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.033372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.033613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.033846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.034085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.034339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.034582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.034825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.035049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.035272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.035525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.035753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.035995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.036235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.036457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.036682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.036921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.037161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.037397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.037638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.037864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.038085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.038307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.038536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.038757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.038981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.039202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.039463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.039694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.039922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.040192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.040435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.040726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.041079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:10:00.041235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.041346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:10:00.041502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.041607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] command line args: [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:10:00.041794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.041957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:10:00.042076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.042254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ================================================================================ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:10:00.042343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.042523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.042699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.042858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] config_dir = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.042999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.043129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.043267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] config_source = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.043267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] debug = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.043554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.043685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.043854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.043976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.043976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.044302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.044423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.044552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.044663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.044742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.044850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.044990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_config_append = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.045075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.045155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.045334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_dir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.045420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.045507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.045768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.045931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.046104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.046254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.046386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.046524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.046635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.046723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.046847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.046961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.047041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.047209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.047338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.047482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.047706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.047799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.048058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.048151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.048298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.048382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.048536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.048617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.049162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.049245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.049410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.049522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.049688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.049812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.050061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.050202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.050310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.050389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] publish_errors = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.050549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.050634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.050795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.050874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.050980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.051063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.051226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.051332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.051494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.051571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.051708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] standard_threads = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.051787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.051937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.052182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.052358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.052536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] use_journal = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.052766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] use_json = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] use_stderr = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.052949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] use_syslog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.053133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:10:00.053364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.053994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.054919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.055905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.external = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.056928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.password = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.token = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.057856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.058956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.059993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.060979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.061905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.062982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.063930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064396 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.064949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.065867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.066983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.067905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.068980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.069940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.070992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.071940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.072858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.073957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.074950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.075995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.076976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.077935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.external = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.078895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.password = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.token = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.079860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.080941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.081963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.082911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.083993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.084939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.085944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.086878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.087862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.088959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] role.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] role.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.089962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.090899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.091835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.092973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.093970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.094928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.095913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.096987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097305 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.097997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.098937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.099908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.100990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.101924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.102951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.103895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.104977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.105980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:10:00.106591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.106894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.107268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.107529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.107769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.108016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.108260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.108499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.108737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.108977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.109228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.109475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.109711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.109961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.110211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.110447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.110693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.110933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.111172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.111460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] role.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.111680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] role.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.111912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.112161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.112417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.112663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.112910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.113158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.113405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.114023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.114023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.114171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.114353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.114603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.115418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.115418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.115550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.115752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.116002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.116252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.116502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.116752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.116986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.117242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.117496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.117735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.117973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.118204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.118449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.118685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.118940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.119186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.119453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.119690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.119919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.120154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.120389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.120636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.120872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.121125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.121370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.121607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.121850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.122091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.122848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.123062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.123320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.123557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.123805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.124058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.124286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.124532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.125041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.125335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.125584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.125833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.126075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.126318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.126557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.126794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.127032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.127269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.127540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.127781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.128024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.128259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.128505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.128746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.128989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.129222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.129463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.129698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:10:00.129868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:10:00.137508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.137737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.138030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.146396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.154701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.154929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.155168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.163727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.175229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.175481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.183143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.183405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.313145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.324946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.362825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.363044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.364104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.364346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.429987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.430048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.430125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.430213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.430404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.430587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.454447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.454639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.454922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.455990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.456072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.456191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.456324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.466864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.467208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.479769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.480945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.481078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.481199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.481355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.481488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:10:00.498215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.498377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:10:00.498735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.498913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:10:00.499164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:10:00.499346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:10:00.499767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.499978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.500096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.500295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.500474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.510867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.511137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.511421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.511612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.511710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.511875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.512105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.512412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.519823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.520650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.523090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.523361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.523781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.523968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.524099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.524249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.524338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.524569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.524840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.524932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.525974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.526217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.526489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.526761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.553008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.554482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.554643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.554929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.556162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.556568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.560305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.560571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.560856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.561969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.562238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.562515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.568266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.568480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.569968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.570256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.573122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.573395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.573664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.573937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.574205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.574470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.574729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.574812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.574975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.575132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.575337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.575789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.576063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.576337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.576594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.576874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.594576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.594861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.595875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.596175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.599634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.600938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.603523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.603694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.604772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.605071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.608767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.610215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.612478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.613859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.616248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.616540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.616951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.617285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.617539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.617670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.617865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.617992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.622818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.622818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.622818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.622818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.637403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.637808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.638110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.638379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.641618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.641944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.642197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.645275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.646730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.648521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.648759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.650811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.651856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.652129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.652401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.652588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.652723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.652887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.653057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.656084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.656341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.656631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.656915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.657211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.666508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.666782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.667039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.667354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.667631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.667905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.668171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.670863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.671142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.671450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.671729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.671993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.672271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.672584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.688444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.694862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.695017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.695093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.695572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.696702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.698332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.698600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.698875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.698963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.700596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.702348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.702624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.702902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.706525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.708207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.710467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.711484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.711780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.712057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.712245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.712360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.715547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.715841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.716200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.716469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.721858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.722139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.722425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.725697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.725985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.726263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.730342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.730623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.730892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.731166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.731439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.731797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.732045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.732311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.732580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.732841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.733107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.733360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.733623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.733881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.734507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:10:00.734795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.735074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.735373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.735647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.735912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.736187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.736455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.736733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.737000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.737276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.737542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.737818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.738072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:10:00.771830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582496579c0 pid: 80319 (default app) Jul 20 19:10:00.775402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568041cc-f67d-4edf-9484-c47114c1d55d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.775694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568041cc-f67d-4edf-9484-c47114c1d55d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.775966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568041cc-f67d-4edf-9484-c47114c1d55d None None] PATH_INFO: `/v3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.776777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582496579c0 pid: 80318 (default app) Jul 20 19:10:00.780345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 791 bytes} [Wed Jul 20 19:10:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:08.656794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:08.657365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:08.657365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:08.661777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1/2] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:08.667700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:08.668208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:08.668208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:08.737780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: INFO dbcounter [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] Registered counter for database keystone Jul 20 19:10:08.763044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG oslo_db.sqlalchemy.engines [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:10:08.774548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writer thread running {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:10:08.958943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80319) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:10:08.959351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80319) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:10:09.014773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:09.016611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:09.148585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 2/3] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 19:10:09.376144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:09.456580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: INFO dbcounter [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] Registered counter for database keystone Jul 20 19:10:09.482495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG oslo_db.sqlalchemy.engines [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:10:09.492331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writer thread running {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:10:09.612535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64514-a5ea-450d-9c76-b100af019cb1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:09.618037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:09.618731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:09.619008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:09.619289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:09.629092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:09.682034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:10:09.682612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805804e-8d0d-4b7d-9773-027f296333c5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:09.701735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 2/4] 10.222.0.82 () {58 vars in 1324 bytes} [Wed Jul 20 19:10:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:10:09.708324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:09.725003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744e350-da92-4bdb-92a9-3ea1e254aefe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:09.729445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:09.730608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:09.730892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:09.731167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] PATH_INFO: `/v3/projects/8244e79834fb42488dc5fd64702925b0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:09.735550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] RBAC: Authorizing `identity:get_project(project_id=8244e79834fb42488dc5fd64702925b0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:09.787219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING keystone.common.rbac_enforcer.enforcer [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:10:09.787593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856771-c3e9-4629-b42d-ae9e154eee49 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:09.792418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 3/5] 10.222.0.82 () {56 vars in 1207 bytes} [Wed Jul 20 19:10:09 2022] GET /identity/v3/projects/8244e79834fb42488dc5fd64702925b0 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:11.824848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d06-bbdc-401a-b303-975a3fee3abf None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.825910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d06-bbdc-401a-b303-975a3fee3abf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.825910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d06-bbdc-401a-b303-975a3fee3abf None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.832662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 3/6] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:11.841738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.842172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.842257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.863470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:11.865006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:11.873876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 19:10:11.896646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8d06-bbdc-401a-b303-975a3fee3abf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.913628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8d06-bbdc-401a-b303-975a3fee3abf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:11.919595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:11.920266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.920548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.920826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.931010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:11.932890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f524f-8945-4303-a4b3-29335ec81782 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:11.942416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1324 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:10:11.948530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.959337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5b85-f773-4e08-b41a-c76c4b8764e2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:11.965284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:11.966366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.966648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.966930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.968428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:11.970292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173dee9-83e8-472b-8192-48518854c358 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:11.971967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 5/9] 10.222.0.82 () {56 vars in 1198 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:14.080240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278a871-ab18-4a5b-94ac-b0b9454846b5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.080815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278a871-ab18-4a5b-94ac-b0b9454846b5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.080815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278a871-ab18-4a5b-94ac-b0b9454846b5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.082163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 5/10] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:14.087848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.088310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.088406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.106690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:14.107942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:14.120634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48b0c-265e-4b5d-a0a2-773f212c3f0d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.120886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48b0c-265e-4b5d-a0a2-773f212c3f0d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.121197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48b0c-265e-4b5d-a0a2-773f212c3f0d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.122630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 6/11] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:14.127759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.128046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.128322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.169363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80318) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:10:14.169771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80318) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:10:14.195221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 6/12] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:14.215919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:14.217561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:14.218839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.249130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.328542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 7/13] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:14.342049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc6ea7-dea7-4bc1-9886-c9241c64d957 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.350241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.375991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.376809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.377093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.377371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.389337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:14.400450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:14.401393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:14.402234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 7/14] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:14.407857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.456621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185f889-5796-41e9-a2bf-6b47c2b4dd4f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.458985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.496256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.497181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.497465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.497742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.499346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.519071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a9d3-0e2d-4bcd-a530-b942f4287604 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.555183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.555723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.556012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.556285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.557047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:14.557343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.558769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.571447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 8/15] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:14.572208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.573834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.577469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.687200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7177-f37d-44ea-bafa-c65669b7590f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.692580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 8/16] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:14.698999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.701772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.723427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.724333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.724625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.724909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.726208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.727713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.729897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 9/17] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:14.735988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.751329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.807806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96c46-82a6-4577-ba9f-085d8d712349 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.841676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2467-2d3c-4dd7-8dcd-ee912a44927a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.842069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.842859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.843145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.843445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.862437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.864036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.876629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.877451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.877743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.878005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.879228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.880725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.882388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 10/18] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:10:14.884599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:14.885547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:14.886573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:10:14.886573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:10:14.886573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:14.886573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:14.886573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 9/19] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:14.888580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.892771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.950247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.972753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.992068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915dc46-2abb-47a0-83d7-d2487dfe64f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.994319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3d07-cf12-401d-9eec-0eae0f0a94d6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:15.026619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:15.027331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:15.027594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:15.027881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:15.028764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:15.029523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:15.029718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:15.029968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.domain.id=default, user.id=ee75234fc7604aa08cbc0948f9b33ca5) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:15.030061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:15.030287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:15.030721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:15.031028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:15.031801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27884c-9d38-42b0-a2a1-2191802bd9bc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:15.032459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731b30f-ed75-48e8-9add-2103d13c022c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:15.039115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 11/20] 10.222.0.82 () {56 vars in 1322 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/role_assignments?user.id=ee75234fc7604aa08cbc0948f9b33ca5&scope.domain.id=default&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:15.052439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 10/21] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:17.404808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d585-942c-4f68-97b0-ce850b37fdf6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.405345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d585-942c-4f68-97b0-ce850b37fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.405345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d585-942c-4f68-97b0-ce850b37fdf6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.407035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 12/22] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.413804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243ce7-8d98-496c-a4eb-70e715a90045 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.414656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243ce7-8d98-496c-a4eb-70e715a90045 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.415091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243ce7-8d98-496c-a4eb-70e715a90045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.443045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-56243ce7-8d98-496c-a4eb-70e715a90045 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:17.444535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-56243ce7-8d98-496c-a4eb-70e715a90045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:17.543944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 11/23] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:17.559270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6a-b743-4004-b73a-c430445cfdf9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.559904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6a-b743-4004-b73a-c430445cfdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.560414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6a-b743-4004-b73a-c430445cfdf9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.562082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.570862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.571266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.571452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.576893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec6a-b743-4004-b73a-c430445cfdf9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.617619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:17.618868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:17.737255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.778478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 12/25] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:17.820906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.845179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec6a-b743-4004-b73a-c430445cfdf9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.918384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.919267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.919581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.919937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.947700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-abe5881a-edac-45f5-9f45-960e8c81741c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:17.955628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:17.956562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:17.957324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:17.968010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 14/26] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:17.972834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231d6b-250d-4830-9c4c-ea4ea3c44f9d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.973231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231d6b-250d-4830-9c4c-ea4ea3c44f9d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.973976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231d6b-250d-4830-9c4c-ea4ea3c44f9d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.980480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 15/27] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.981556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231d6b-250d-4830-9c4c-ea4ea3c44f9d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.995299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.061971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8da8-3b2b-4470-ac49-a870082eab7b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.130716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.130922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.131168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.131462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.132281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.133739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83591dc-4f42-4c50-ab46-0e3b7a11de63 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.224036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231d6b-250d-4830-9c4c-ea4ea3c44f9d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.276233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 13/28] 10.222.0.82 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/roles => generated 219 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:18.277871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.278192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.278502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.298213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:18.300320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:18.303486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.304303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.304588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.304861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.305641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:18.305946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.307403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.323362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 16/29] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.329752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.336214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.383461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 14/30] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:18.407986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.461150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.525140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0523-0c49-48fb-a7ba-059ab130a831 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.545262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63947433-1cf8-456a-b08c-0e0d1be21044 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.566119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.567446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.567949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.568456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.580813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.582982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7a8a2a14-74ed-4536-8876-f6815a4fff8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:10:18.603708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:18.604575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:18.605365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:10:18.605365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:10:18.605365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:18.605365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:18.607102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 15/31] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:18.608863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59698e8c-8bc0-4cd4-b79a-acb2f62157d7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.609323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59698e8c-8bc0-4cd4-b79a-acb2f62157d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.609715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59698e8c-8bc0-4cd4-b79a-acb2f62157d7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.611206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 16/32] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:18.618355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.618913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.619611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.641138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:18.643016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:18.648148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.649622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.649622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.649622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.656296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.657856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.660947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 17/33] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:18.660947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.671016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.760052 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 17/34] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:18.761659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.827135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2d086-2559-44c7-8279-54294692a9b9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.881820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.882716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.883102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.883497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.884583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:18.885121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.888378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.890538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.909880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 18/35] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.910732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.950184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b5f5-f2a5-48b1-aff0-c7fd657f9129 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.989585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.990730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.991018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.991295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.992991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.994629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.996570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 18/36] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.997513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.030475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215f44-6ddf-431c-996e-3b6eda487e61 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.039679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.069687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.070803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.071251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.071602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.072384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.073818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc71302-4819-429c-8446-763d3ccfc5ef None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.118662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f8a4-9dbe-409c-8731-a7abe6b46d8e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.155537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.156228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.156511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.156792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.157514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.158993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.200877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 19/37] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:19.202923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.213697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 19/38] 10.222.0.82 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/roles => generated 225 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:19.215376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37841-2cee-42d1-b810-7ed2c66c2c19 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.215768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37841-2cee-42d1-b810-7ed2c66c2c19 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.216050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37841-2cee-42d1-b810-7ed2c66c2c19 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.217867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 20/39] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:19.231391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d1a1-0cc6-464f-bdc7-39534609b535 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.231391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d1a1-0cc6-464f-bdc7-39534609b535 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.231391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d1a1-0cc6-464f-bdc7-39534609b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.251528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f8b9d1a1-0cc6-464f-bdc7-39534609b535 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:19.253353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f8b9d1a1-0cc6-464f-bdc7-39534609b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:19.347732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.351370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.372380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 21/40] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:19.384555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7e633-4fa4-40b3-a94b-22f23ef111b2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.384932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7e633-4fa4-40b3-a94b-22f23ef111b2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.385120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7e633-4fa4-40b3-a94b-22f23ef111b2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.391154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 22/41] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:19.398835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.399155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.399697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.413657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ee8-9b6e-4b5d-8999-e30835490237 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.422299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:19.424568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:19.475824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.477373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.477873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.478369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] PATH_INFO: `/v3/domains/default/users/ee75234fc7604aa08cbc0948f9b33ca5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.483008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ee75234fc7604aa08cbc0948f9b33ca5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.485912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.514088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 20/42] 10.222.0.82 () {58 vars in 1361 bytes} [Wed Jul 20 19:10:19 2022] PUT /identity/v3/domains/default/users/ee75234fc7604aa08cbc0948f9b33ca5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:19.515332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.529983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 23/43] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:19.555031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.692513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8fa-6f21-4b27-a521-74fd3fe259fc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.722201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6e1a5-5312-4fb3-be44-63daad88201b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.731084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.744935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.745935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.746219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.746489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.747393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.748923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.766234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 21/44] 10.222.0.82 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:19 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:19.867283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.896721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.897593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.897870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.898156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.899576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.901358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5532-9068-4e94-b6ff-c4fb81b2be7d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.903606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 24/45] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.909522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:20.050971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f247d4-93c7-4170-8948-fcb2c1156c0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:20.096386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:20.097310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:20.097594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:20.098006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:20.099138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:20.102280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce60d59-5c8e-4f74-a020-e864747267b0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:20.144309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 22/46] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:19 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:10:21.674139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c65-e006-423f-9522-80ff6709e51c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.674743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c65-e006-423f-9522-80ff6709e51c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.674743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c65-e006-423f-9522-80ff6709e51c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.676099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 25/47] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:21.682796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.683292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.683401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.702792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:21.704100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:21.742451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:21.893798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 23/48] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:21.916899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1c65-e006-423f-9522-80ff6709e51c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.026049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1c65-e006-423f-9522-80ff6709e51c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.061653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.062489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.062768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.063049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.073798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-67f53ca4-4e43-49bb-af13-9cb877833f71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:22.081862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:22.082745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:22.083938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 26/49] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:22.089238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.194547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dc89c-5ad4-4c7d-85ac-eceb25a9cc21 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.230910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.231149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312854-912f-408c-8cae-68183337e000 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.231374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312854-912f-408c-8cae-68183337e000 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.231657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312854-912f-408c-8cae-68183337e000 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.231745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.231939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.232245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.232971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:22.233227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 27/50] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:22.233457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.234858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.238557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.238847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.239123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.247896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 24/51] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:22.256416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.262050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:22.263966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:22.293582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.301351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.333137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 28/52] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:22.356562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.362820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6a12-704b-486f-bbae-44a80af99221 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.397151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.398043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.398324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.398637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.399853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.401313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.402950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 25/53] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:22.408682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.471709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e408b-0313-4d8f-b469-05eb0b52eae0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.507765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.508539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.509900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.509900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.510283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.511827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.513598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 29/54] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:22.519831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.525170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.528648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a651-4d87-4d34-a5c3-781d75dde4b2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.567109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.567746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.567962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.568251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.568531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.569916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.571644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.573368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 26/55] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:22.579577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.650430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbc0aa-91aa-41d9-a265-18bb8eca9e76 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.695093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.695923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b7ab-0067-40b5-bf90-6f4abe0583b4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.696302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.696302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.696498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.697123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.698681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76a0be-6371-4098-9730-6f09a6c15e3d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.729221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 30/56] 10.222.0.82 () {60 vars in 1140 bytes} [Wed Jul 20 19:10:22 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:10:22.736543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.737096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.737380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.737651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.738548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.domain.id=default, user.id=ee75234fc7604aa08cbc0948f9b33ca5) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:22.738851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.740443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb07e1-4bd6-4c08-aa10-916720978530 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.750404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 27/57] 10.222.0.82 () {56 vars in 1322 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/role_assignments?user.id=ee75234fc7604aa08cbc0948f9b33ca5&scope.domain.id=default&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:25.012322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784579-d2ac-4d9d-9880-c839804fd3b8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.012883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784579-d2ac-4d9d-9880-c839804fd3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.012972 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784579-d2ac-4d9d-9880-c839804fd3b8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.014373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 31/58] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:25.020061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.020542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.020627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.038425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:25.039676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:25.067613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.110275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 28/59] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:25.139395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784579-d2ac-4d9d-9880-c839804fd3b8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.254774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.267947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784579-d2ac-4d9d-9880-c839804fd3b8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.314557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.315479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.315767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.316012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.317186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.318806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a4036-a2c1-4198-aa89-f6859b2fe2af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.320629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 32/60] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:25.326764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.434060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5302cd-69db-48a1-be02-1644f4a1d283 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.468477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.469160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.469442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.469714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.470430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.471951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea3c9-33e6-4256-8773-bd91cc3b10a0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.499772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 29/61] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:25 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:29.014472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87d05-728d-4edb-8e77-44ab28c42491 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.015006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87d05-728d-4edb-8e77-44ab28c42491 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.015276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87d05-728d-4edb-8e77-44ab28c42491 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.016736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 33/62] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:29.023346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e021-3e17-45ef-9b36-2a838813e28a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.023844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e021-3e17-45ef-9b36-2a838813e28a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.024169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e021-3e17-45ef-9b36-2a838813e28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.053935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0207e021-3e17-45ef-9b36-2a838813e28a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:29.055166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0207e021-3e17-45ef-9b36-2a838813e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:29.077252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:29.158173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 30/63] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:29.170524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cf63-6560-464b-9083-9707fa341742 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.171168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cf63-6560-464b-9083-9707fa341742 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.171687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367cf63-6560-464b-9083-9707fa341742 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.173764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 34/64] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:29.179907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae742-bfeb-478c-b835-3a3bc3594e9a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.180549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae742-bfeb-478c-b835-3a3bc3594e9a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.181030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae742-bfeb-478c-b835-3a3bc3594e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.199765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5dcae742-bfeb-478c-b835-3a3bc3594e9a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:29.201468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5dcae742-bfeb-478c-b835-3a3bc3594e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:29.205696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367cf63-6560-464b-9083-9707fa341742 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.294787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 31/65] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:29.297075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45635b69-d949-446b-a151-aee612cf0215 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.297588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45635b69-d949-446b-a151-aee612cf0215 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.298091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45635b69-d949-446b-a151-aee612cf0215 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.301145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 32/66] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:29.303447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648877f4-2d45-45f7-8e41-a64d10705844 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.304174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648877f4-2d45-45f7-8e41-a64d10705844 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.304864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648877f4-2d45-45f7-8e41-a64d10705844 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.307799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 33/67] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:29.316719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.317628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.318426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.342218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367cf63-6560-464b-9083-9707fa341742 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.348641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:29.350254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:29.387019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.388210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.388703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.389172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.404236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-945e7650-aa88-400b-bb90-c858ae4de1e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:29.413946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:29.414978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:29.415862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:29.421968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 35/68] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:29.424203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.424621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.424989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.443418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 34/69] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:29.443418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.452929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:29.455845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:29.460937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:29.477296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:29.546945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 36/70] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:29.547796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.602897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7506f1-932a-4c9c-b215-56b38526ef5c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.668106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.669496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.669956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.670403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.691570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:29.705803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73676d1-9b2d-4052-8bb7-e0898a18c457 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:29.708975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:29.709839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:29.710607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:29.711178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 35/71] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:29.712632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.765008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.766210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.766705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.767171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.768695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:29.769227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:29.771839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:29.792503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 37/72] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:29.792503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.803405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:29.816266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:29.853832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd39f-c61b-4dc1-b521-fc992f364789 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.901364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.902461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.902810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.903293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.917390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7b1b14bb-3522-4dfe-a3bf-eca97ff4716c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:29.926604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:29.928407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:29.929827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 36/73] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:29.933521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ede-ad79-48b2-822d-4bfe6665c20f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.934006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ede-ad79-48b2-822d-4bfe6665c20f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.934924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ede-ad79-48b2-822d-4bfe6665c20f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.941061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 37/74] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:29.941061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464ede-ad79-48b2-822d-4bfe6665c20f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.964681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764c7-0008-4d0e-bc90-af61dd52a517 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.004573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.005429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.005702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.005975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.019108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:30.027068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:30.028058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:30.028822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 38/75] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:30.029433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.100923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464ede-ad79-48b2-822d-4bfe6665c20f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.131255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.139648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.144560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.145304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.145589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.145864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.146644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:30.146958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.148475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.158390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 38/76] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.159278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.188652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed035b-41fd-4511-8205-4fd31ad3a2ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.226660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.227886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.228165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.228446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.249036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.251665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68731ef8-2f46-43f8-b171-fa058c603f9a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.254775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 39/77] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.256919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.257363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.257782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.271912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43004e1-73ff-4e81-a024-ddca0b71aad0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.288284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:30.290424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:30.315872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.316795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.317174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.317551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.318459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:30.318872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.320657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.337755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 39/78] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.337755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.379733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 40/79] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:30.381167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.398205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.457315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee2122-df51-4c07-8f08-9d5276b733ae None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.463526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.501646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.502500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.502937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.503400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.504432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:30.504811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.506536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.516161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb23a6-5392-46a2-b1de-e9e411beac05 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.517005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 40/80] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.518418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.569631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.570536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.570818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.571092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.572407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.573988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.575702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 41/81] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.576494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.645288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b93e0-93f0-4bbc-b490-57833e5646fa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.661397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.687738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65aab9-071e-4bf9-ba5c-1e407cde7a0f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.699415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.700138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.700429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.700705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.717475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.727044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.727996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.728286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.728568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.729955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.731733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.733508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 42/82] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.739595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.779644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.844152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a3c1-5183-45ce-a3c1-404440289825 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.884045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 41/83] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:30.885226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.885412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.886240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.886521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.886795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.888405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.889921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.891674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 43/84] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.892834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.908027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.962757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.000021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67a8f2-495d-401e-8cbf-89adff99ace5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.005411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536896-ef70-434c-9975-bb2f8452d394 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.035568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.036503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.036788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.037067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.038441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.039961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.041844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 42/85] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.042238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.044577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.044664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.044664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.044664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.128393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.129937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.132260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.151585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6e8a-c1d4-47ec-be34-8cda469a9b29 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.187759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.188309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.188584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.188851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.201703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.251395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 44/86] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:31.252445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.280257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.281820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.369496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b595c5c-8675-45b6-84c5-2548cd41083d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.383328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.404568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 43/87] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:31.405427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.407170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.408109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.408395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.409502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.409970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.411507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.413302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 45/88] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.414508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.447222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.512861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641afbb-fe4b-47a9-96e7-046201b3731e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.523696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7e705-7f52-4573-92e5-1a08e44145d2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.550964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.551957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.551957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.552243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.553040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.554543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.560431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc475-5466-4340-a501-46d310e6502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.561128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc475-5466-4340-a501-46d310e6502b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.561975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc475-5466-4340-a501-46d310e6502b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.561975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc475-5466-4340-a501-46d310e6502b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.586265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 44/89] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:31 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:31.587141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.646828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.665885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cc475-5466-4340-a501-46d310e6502b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.668187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cc475-5466-4340-a501-46d310e6502b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.712169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.741958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e027d-af58-4ada-98cd-a627ccb503bc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.786907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.787879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.788167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.788447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.789738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.791258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.793255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 45/90] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.794034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.840746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 46/91] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:31.842515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc475-5466-4340-a501-46d310e6502b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.943818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4faf53-4c6c-4f2a-83c2-0bb8c9d9bf60 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.961723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.006656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.008007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.008479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.008952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.010460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.012170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.013875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc475-5466-4340-a501-46d310e6502b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.014538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 46/92] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.015553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.078033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.088750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.090066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.090578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.090940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.092193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.093210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.096030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.103595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 47/93] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.109239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.243484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0f185-9c2b-4bef-b52f-d28752ff73b8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.329383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.330312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.330733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.332432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.333649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ee75234fc7604aa08cbc0948f9b33ca5) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.334174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.337329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.351707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 47/94] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/role_assignments?user.id=ee75234fc7604aa08cbc0948f9b33ca5&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.352711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.384868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9b4d8-1efe-4097-bb95-1a449c3455c6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.459492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.472378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.473756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.474238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.474705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] PATH_INFO: `/v3/projects/303ef6eccb274f629ce5996890264b54` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.482096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] RBAC: Authorizing `identity:get_project(project_id=303ef6eccb274f629ce5996890264b54)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.484327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.486917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 48/95] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/projects/303ef6eccb274f629ce5996890264b54 => generated 312 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.498991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.542479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878d7a7-d2c5-4411-8276-43ff07c03945 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.584646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.585294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.585581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.585863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.586758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.587077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.591090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3bab-a9fc-459b-8b19-8538cb77c9ee None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.596811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 48/96] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=300694bf267d40f9898c40333aa080ec => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.661313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.727442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444e95-7c3d-4102-99a9-0d7646e1bdad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.789080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.790159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.790683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.791150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=303ef6eccb274f629ce5996890264b54, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.792818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.794579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02613076-d674-44a9-88f0-4029ddf98946 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.808696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 49/97] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=303ef6eccb274f629ce5996890264b54&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:34.823189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853ea6-9e62-445c-85e9-bc78bc7db97d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.823758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853ea6-9e62-445c-85e9-bc78bc7db97d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.823758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853ea6-9e62-445c-85e9-bc78bc7db97d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.825259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 49/98] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:34.830755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8d24-2d0a-40b8-a653-b5c57c8aee6c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.831216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8d24-2d0a-40b8-a653-b5c57c8aee6c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.831432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8d24-2d0a-40b8-a653-b5c57c8aee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.852426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-906d8d24-2d0a-40b8-a653-b5c57c8aee6c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:34.853663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-906d8d24-2d0a-40b8-a653-b5c57c8aee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:34.953496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 50/99] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:34.992597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853ea6-9e62-445c-85e9-bc78bc7db97d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.040257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a68db-311e-4f55-b8d3-4d6e3686b60d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.040607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a68db-311e-4f55-b8d3-4d6e3686b60d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.040824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a68db-311e-4f55-b8d3-4d6e3686b60d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.042265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 51/100] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:35.056294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7a2c-92b7-449d-8542-aa2eec1c70de None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.056632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7a2c-92b7-449d-8542-aa2eec1c70de None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.056861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7a2c-92b7-449d-8542-aa2eec1c70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.091496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c4e7a2c-92b7-449d-8542-aa2eec1c70de None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:35.092907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c4e7a2c-92b7-449d-8542-aa2eec1c70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:35.159710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.172645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 52/101] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:35.179638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0960-515e-49c8-9ed5-9edd6f148e55 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.181337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0960-515e-49c8-9ed5-9edd6f148e55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.181781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb0960-515e-49c8-9ed5-9edd6f148e55 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.183462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 53/102] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:35.190478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.191107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.191698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.210696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:35.212281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:35.219808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853ea6-9e62-445c-85e9-bc78bc7db97d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.223790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.301954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.302786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.303064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.303360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.321313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:35.321638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 54/103] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:35.322618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:35.340344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:35.341430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:35.342351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:35.344523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 50/104] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:35.354302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.475559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a8f01-f020-41bb-96f2-bad3e53d61d6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.522187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.523124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.526778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.528244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.529468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:35.531179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.532931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.551667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 51/105] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:35.554492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.591594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acff76-707d-481b-b1ea-28b82c622291 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.591936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.617485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.646059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.646907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.647198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.647509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.654354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.654354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.654354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 55/106] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:35.659338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.738350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86e60-5d37-4b9c-8700-f205be296ce9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.793749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.794580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.794870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.795147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.807198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:35.808990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fccd04-fdbe-49f8-ada7-1fbc04283696 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7c5a0948-a334-4f68-8b9e-5ceb29c73449 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:35.815564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:35.817180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 52/107] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:35.818692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890014-1125-4660-8b02-d4a29530f679 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.820761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890014-1125-4660-8b02-d4a29530f679 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.820761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890014-1125-4660-8b02-d4a29530f679 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.820761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 53/108] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:35.821390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6890014-1125-4660-8b02-d4a29530f679 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.854887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.855849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.856323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.856765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] PATH_INFO: `/v3/users/0a580254d62149bb88ba67e22663c93d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.879450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] RBAC: Authorizing `identity:get_user(user_id=0a580254d62149bb88ba67e22663c93d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.881830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacaf85-1128-44de-92e0-a9a6ea39634a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.884360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 56/109] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/users/0a580254d62149bb88ba67e22663c93d => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:35.885699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.886275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.886693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.905752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:35.906956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:35.932131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.951802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6890014-1125-4660-8b02-d4a29530f679 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.954209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.984241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 57/110] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:35.985558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.995124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.997287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.997810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.998458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.000635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.004249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102a3bd-88d4-4fef-87b0-5a89672631ce None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 54/111] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:35 2022] POST /identity/v3/projects => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07ad4-f7e7-4312-bbc8-0559c0e72bfa None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07ad4-f7e7-4312-bbc8-0559c0e72bfa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07ad4-f7e7-4312-bbc8-0559c0e72bfa None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 55/112] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:36.048000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c07ad4-f7e7-4312-bbc8-0559c0e72bfa None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.133024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425502f-9b82-41aa-893c-14ba14b92982 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.185735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.187230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.187230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.187550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.188691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:36.189151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.191602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.193551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c07ad4-f7e7-4312-bbc8-0559c0e72bfa None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.206855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 58/113] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.209144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.255536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.256665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.257672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.257998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.258321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.266733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.347414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730bdc1-695f-4ba0-8e25-c7d5f3c31ca5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.371355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.374268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.401541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.403008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.403565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.404067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.424564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2b544891-da83-4338-b9d5-1c16e2155a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:36.434315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:36.435668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 59/114] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:36.442622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dc21-a4e1-4016-9410-27f800897e60 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dc21-a4e1-4016-9410-27f800897e60 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756dc21-a4e1-4016-9410-27f800897e60 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 60/115] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.443701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.460077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:36.461282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:36.543831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 56/116] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:36.543831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.544071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 61/117] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:36.544071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.573290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.586916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.671817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01533c7-16d3-497c-9802-512bd876d431 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.687990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cc510-fd8e-4672-8fd7-236c5807c6d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.719755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.720459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.720748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.721029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.721801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:36.722113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.723604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162620-50c3-4cf4-93ea-89c6caa219af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.727078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.728385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.728878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.730028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.731948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.733098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 62/118] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.734137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.734432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.734730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.735010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.736898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 57/119] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.738126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.759594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:36.760812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:36.841889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 63/120] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:36.843278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.861174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a976639-45b2-47fc-96cb-ee995fe253e1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.864655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.880632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.907020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.907918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.908372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.908504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.909664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.911192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.917844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 58/121] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.917844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.979464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe136-d275-415c-aab9-a7999ddbdc81 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.018808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.019647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.019929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.020203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.028381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172422-f948-4e22-ab21-b92e46426694 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.032225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:37.040352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:37.041276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:37.042035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 64/122] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:37.042671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.073484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.074361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.074673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.074988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.076282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.077752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.079512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 59/123] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.080296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.125656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.131867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.155496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bffe-38df-4c4e-9c6f-18af37751131 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.191211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.191659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd45f-2e82-4ede-99ea-e170703bd81d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.192275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.192628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.192976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.194701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.195743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.197641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 65/124] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.198198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.240147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.241150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.241430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.241699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.258196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:37.271832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:37.273529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 60/125] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:37.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.325922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbde08-2a5d-4a5b-b6dd-28d7239a4699 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.364230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.365211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.365489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.365763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.366644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=0a580254d62149bb88ba67e22663c93d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:37.366953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.368488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.375347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 66/126] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/role_assignments?user.id=0a580254d62149bb88ba67e22663c93d&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=949ce506f27a40e69dcb774891841f16 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.376082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.402452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.407495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.411278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28833d16-fcbc-46cb-ae3f-0701f61e1732 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.452560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.453282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.453563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.453876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.454647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:37.454951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.457374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.467145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 61/127] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.468090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.544216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fec3e-83b7-4bdd-89fd-c02dc1f6e027 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.589359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9626-3150-42ec-9be7-68e884a0ad27 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.590484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.591717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.593009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.593312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ccc514bd462946f1bf3425c214f1d782/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.595571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, user_id=ccc514bd462946f1bf3425c214f1d782, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.597114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.623418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 67/128] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:37 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ccc514bd462946f1bf3425c214f1d782/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:37.624933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.645177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.646018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.646303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.646581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.648189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.649892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.655767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 62/129] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.655767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.729197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.768778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.803535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fd5f9-6682-4181-a54d-e6c73977160b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.860959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a9b42-2273-4505-9b67-2b757a4ec03a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.867728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.868426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.868715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.868996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.869765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:37.870077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.871806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.881272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 68/130] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.882130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.906750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.907698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.907983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.908260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.909512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.911227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.913049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 63/131] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.914032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.000325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcdb06-ac4e-470b-a37b-83ce99b9041b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.029458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.034160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06aea2-5b41-4ff5-96ec-07d72fb433a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.042629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.050920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.052129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.052935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.053222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ee75234fc7604aa08cbc0948f9b33ca5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.055844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, user_id=ee75234fc7604aa08cbc0948f9b33ca5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.057408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.074804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 69/132] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:37 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ee75234fc7604aa08cbc0948f9b33ca5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:38.075601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.095827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.096797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.097137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.097416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.098796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.108083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.110203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 64/133] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:38.116195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.207530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf02d-aa81-4a63-8d12-dd4b01cfa562 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.250653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.251704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.252238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.252628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] PATH_INFO: `/v3/projects/303ef6eccb274f629ce5996890264b54` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.254187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] RBAC: Authorizing `identity:get_project(project_id=303ef6eccb274f629ce5996890264b54)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.256113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.258502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 70/134] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/projects/303ef6eccb274f629ce5996890264b54 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:38.264619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.334672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0dc0a-366c-4b00-b541-c5c997cbdc5e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.335767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.400994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eceecd-1786-46e4-a100-375e1bde621e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.443861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.445009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.445384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.445673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.447180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.448769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.449069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205682b-2dbb-4133-8dc1-d5c702bd9fc0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.449857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.450142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.450404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] PATH_INFO: `/v3/projects/303ef6eccb274f629ce5996890264b54/users/ccc514bd462946f1bf3425c214f1d782/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.450864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 65/135] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:38.454406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b00d6f-345d-4c46-a9cd-f194e4077d07 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.454771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b00d6f-345d-4c46-a9cd-f194e4077d07 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.455032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b00d6f-345d-4c46-a9cd-f194e4077d07 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.456598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 66/136] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:38.460788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] RBAC: Authorizing `identity:create_grant(project_id=303ef6eccb274f629ce5996890264b54, user_id=ccc514bd462946f1bf3425c214f1d782, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.462264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.462833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.463121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.463431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.485875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 71/137] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:38 2022] PUT /identity/v3/projects/303ef6eccb274f629ce5996890264b54/users/ccc514bd462946f1bf3425c214f1d782/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:10:38.485875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.493678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:38.495275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:38.564821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.724441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 67/138] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:38.756255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f24799-626e-40e3-a6b1-98a2734b515d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.773841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.788354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.815565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.817950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.818431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.818917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ccc514bd462946f1bf3425c214f1d782/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.822986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, user_id=ccc514bd462946f1bf3425c214f1d782, role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.825791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.850595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 72/139] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:38 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/ccc514bd462946f1bf3425c214f1d782/roles/300694bf267d40f9898c40333aa080ec => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:38.938810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0704b7f-c943-4f76-9d78-9bf0ace14b2b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.979130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.980366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.980983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.981555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.988585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.990426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e49f-985e-43c7-a835-1b87e5d14e43 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.992553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 68/140] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:39.004743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:39.243566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497f97-dc92-4e61-a128-f5517f719dc4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:39.294388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.295542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.296069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.296533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.297563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.299982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2ed9-b149-485e-915a-28a1226f0329 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.332908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 73/141] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:39 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:40.063693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7eba7-2561-4dd0-a619-b2498d451881 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.065001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7eba7-2561-4dd0-a619-b2498d451881 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.065709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7eba7-2561-4dd0-a619-b2498d451881 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.068241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 69/142] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:40.086106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.087537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.088218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.116400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:40.117985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:40.160270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.209843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 74/143] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:40.244439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7eba7-2561-4dd0-a619-b2498d451881 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.286737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.381415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7eba7-2561-4dd0-a619-b2498d451881 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.427133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.428386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.428880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.429344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.450279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:40.460372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:40.461409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:40.462352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:40.465521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 70/144] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:40.472282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.595546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbbdb-6835-42b5-b3cc-c992b69a482b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.647689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.648753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.649284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.649756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.650765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:40.651283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:40.653014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:40.663612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 75/145] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:40.670024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.799533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.812369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d40b-c716-4fe2-aa95-b73b36faa9d7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.866936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.867860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.868142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.868418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] PATH_INFO: `/v3/users/0a580254d62149bb88ba67e22663c93d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.876316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] RBAC: Authorizing `identity:get_user(user_id=0a580254d62149bb88ba67e22663c93d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:40.877856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:40.879683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 71/146] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/users/0a580254d62149bb88ba67e22663c93d => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:40.885303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.968096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.024068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee25a74-a54a-45a1-8289-52b986b93304 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.071174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84832-1450-4240-adca-898feb259550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.072116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84832-1450-4240-adca-898feb259550 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.072468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84832-1450-4240-adca-898feb259550 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.072751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84832-1450-4240-adca-898feb259550 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.074038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84832-1450-4240-adca-898feb259550 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.075695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84832-1450-4240-adca-898feb259550 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.077833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 76/147] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:41.084458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.092747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12305-5e73-4997-aa34-4c257ccf4c1b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.093301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12305-5e73-4997-aa34-4c257ccf4c1b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.093301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e12305-5e73-4997-aa34-4c257ccf4c1b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.096249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 77/148] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:41.101948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede396a-b707-4779-b30d-aee213b17567 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.102249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede396a-b707-4779-b30d-aee213b17567 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.102505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede396a-b707-4779-b30d-aee213b17567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.142712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fede396a-b707-4779-b30d-aee213b17567 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:41.143971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fede396a-b707-4779-b30d-aee213b17567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:41.267901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 78/149] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:41.274925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dc93-8a14-4f9a-81d9-cedf63187136 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.306433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede396a-b707-4779-b30d-aee213b17567 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.327062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.328023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.328304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.328581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/0a580254d62149bb88ba67e22663c93d/roles/949ce506f27a40e69dcb774891841f16` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.332102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, user_id=0a580254d62149bb88ba67e22663c93d, role_id=949ce506f27a40e69dcb774891841f16)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.333604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb01f3a-a9f3-4e03-bb86-2da440c77161 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.358707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.363583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 72/150] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:41 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/users/0a580254d62149bb88ba67e22663c93d/roles/949ce506f27a40e69dcb774891841f16 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:41.470709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede396a-b707-4779-b30d-aee213b17567 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.472267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302a057-c2df-41c4-8ada-b5256ff0bedb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.472552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302a057-c2df-41c4-8ada-b5256ff0bedb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.472824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302a057-c2df-41c4-8ada-b5256ff0bedb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.474398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 73/151] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:41.480263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.480554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.480896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.508777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:41.510200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:41.541383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.548547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.549545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.550348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.550348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.576604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:41.585163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:41.586244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:41.587170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 79/152] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:41.604768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.651348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 74/153] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:41.689348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.824937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.863408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac26a8e-60ea-41f4-8a75-615ef685b055 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.914985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eef81-45a1-430c-85bc-4bff9c64339e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.947571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.948275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.948564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.948844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.949660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:41.949971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.951452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.967235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 80/154] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:41.977050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.977867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.978146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.978412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.988655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.000373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:42.008353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:42.009248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:42.010228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 75/155] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:42.016506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.040698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85e3e-42cc-4f7b-8dd1-708b632cd089 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.292430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3e55-7848-4333-a101-deeee526b4b7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.360818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.361560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.361845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.362117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.362888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:42.363189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.364817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.378615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 76/156] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:42.384045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.389438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.390350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.390632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.390906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.396138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.397678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.399477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 81/157] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:42.405298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.443731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.530072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.554943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98c04-f8b9-48d2-90db-5de973034004 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.611400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.612677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.613097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.613505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] PATH_INFO: `/v3/users/ee75234fc7604aa08cbc0948f9b33ca5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.620145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] RBAC: Authorizing `identity:get_user(user_id=ee75234fc7604aa08cbc0948f9b33ca5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.622001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.624006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 77/158] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/users/ee75234fc7604aa08cbc0948f9b33ca5 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:42.632430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.661742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6552-34f0-41b2-a2d1-0b54a7bca13f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.724240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.724728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.725004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.725472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.787717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a05a-0b0d-4e65-86d1-d3110504f87a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.839332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.839332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.846053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.847068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.847575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.848038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.867338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.869642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.948896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.950799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.998253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 82/159] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:43.008406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.103429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 78/160] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:43.104828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.166860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.181922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910c442-2f96-47fc-92ba-286adf22dccd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.219038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.237667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.238702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.239076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.239466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.247351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.247351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.248121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 83/161] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.276405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.300165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd92da-771e-46f7-aea9-d673da4bf260 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.365086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.366173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.366587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.366989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.368351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.370075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400560-5100-408d-817f-17cb78015dd6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.378574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 79/162] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.380308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8a02-f602-4b77-8756-83463ea080a1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.380728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8a02-f602-4b77-8756-83463ea080a1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.381170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8a02-f602-4b77-8756-83463ea080a1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.382611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 80/163] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:43.393415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398ffa-84ff-436d-aa42-d5c23d1d9366 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.393913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398ffa-84ff-436d-aa42-d5c23d1d9366 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.394338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398ffa-84ff-436d-aa42-d5c23d1d9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.420575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-65398ffa-84ff-436d-aa42-d5c23d1d9366 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:43.421816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-65398ffa-84ff-436d-aa42-d5c23d1d9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:43.449035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d1b8-4a5c-42e7-bafa-6ba62fcc408c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.527259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.528011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.528293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.528575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.529449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:43.529766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.531371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.549786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 84/164] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.550783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.582016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 81/165] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:43.583694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a77f-e009-4d42-8f35-5f45c191964d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.583856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a77f-e009-4d42-8f35-5f45c191964d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.584169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a77f-e009-4d42-8f35-5f45c191964d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.585768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 82/166] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:43.598958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.599277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.599549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.641398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:43.642565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:43.707745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.740766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.814127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37b09-9775-4a03-8d16-e477d1ad6dee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.840005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 83/167] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:43.840799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.879941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.881021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.881307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.881583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.882442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ee75234fc7604aa08cbc0948f9b33ca5) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:43.882756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.884797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.897324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 85/168] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/role_assignments?user.id=ee75234fc7604aa08cbc0948f9b33ca5&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.898255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.070430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e9f40-0ffe-4f9b-8e1f-7e7b6161a586 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.085387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2e5de-e3f3-4660-8219-139d1a344070 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.107820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.136116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.137038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.137315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.137589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.146581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.147526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.147783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.148018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.153371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:44.167845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:44.168905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:44.169693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 84/169] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:44.180178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:44.181044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:44.189011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:44.191235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:44.193247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 86/170] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:44.201510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.267790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.340612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d29-43e0-4b53-85fa-6cf3c817d7aa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.390969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.391761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.392047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.392377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.393148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:44.393451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.394890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.403986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa205-88b0-4ed9-a8e7-b9331212766f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.404155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 85/171] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:44.428308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.457454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.458143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.458431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.458709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.459510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:44.459826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.461279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.475789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 87/172] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:44.481793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.535560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.589085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.611529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2b1c2-c5d4-4349-bedc-45ceed3c3214 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.635188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc781134-5cab-4006-8efa-381ae1be19bc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.681657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.682489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.682765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.683036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.685579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.687073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.694377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 88/173] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:44.697714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.703172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.704098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.704372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.704635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] PATH_INFO: `/v3/users/ccc514bd462946f1bf3425c214f1d782` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.707956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] RBAC: Authorizing `identity:get_user(user_id=ccc514bd462946f1bf3425c214f1d782)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.709469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.712671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 86/174] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/users/ccc514bd462946f1bf3425c214f1d782 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:44.723000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.858021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8a193-deb8-4982-bb4c-a177dbb7fa21 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.860196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.900495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.901516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.902002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.902441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.932504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb5bbb-2e32-46a8-b05e-859626ba03cb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.970666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.971706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.972191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.972648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.977061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.978657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b404-c220-4683-a40b-2523b0b050af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.003892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.067687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.069212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fc2bf-b69e-4c30-a772-8bcf6fd0787c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.104354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 89/175] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:45.110843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c3fa-2997-441f-8a56-ccb0d1267753 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.111287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c3fa-2997-441f-8a56-ccb0d1267753 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.111693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c3fa-2997-441f-8a56-ccb0d1267753 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.113124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 90/176] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:45.115105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc38b-3241-4c43-9976-1821e3a6e16a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.115423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc38b-3241-4c43-9976-1821e3a6e16a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.115711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc38b-3241-4c43-9976-1821e3a6e16a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.118447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 91/177] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:45.119374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfc38b-3241-4c43-9976-1821e3a6e16a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.123645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.200432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 87/178] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:45.201640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772496e-438b-4209-9a40-a36362c344a2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.201928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772496e-438b-4209-9a40-a36362c344a2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.202205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772496e-438b-4209-9a40-a36362c344a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.219736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1772496e-438b-4209-9a40-a36362c344a2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:45.220959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1772496e-438b-4209-9a40-a36362c344a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:45.248113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfc38b-3241-4c43-9976-1821e3a6e16a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.278123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.290588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.291516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.291792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.292069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.293353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.300273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 88/179] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:45.300425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75924c5-a2b0-4ff6-bfc4-cc6ec4ecb694 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.300500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.300500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.300500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.300681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 92/180] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.300681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daa7d-e40c-46da-822a-15c6f5d3c334 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.300681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daa7d-e40c-46da-822a-15c6f5d3c334 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.300681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daa7d-e40c-46da-822a-15c6f5d3c334 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.300681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 93/181] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:45.304304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179daa7d-e40c-46da-822a-15c6f5d3c334 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.322564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:45.323865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:45.384216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.398173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 89/182] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:45.407886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.425396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179daa7d-e40c-46da-822a-15c6f5d3c334 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.466477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.467328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.467616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.467891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] PATH_INFO: `/v3/projects/303ef6eccb274f629ce5996890264b54` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.469247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] RBAC: Authorizing `identity:get_project(project_id=303ef6eccb274f629ce5996890264b54)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.470715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c41471-aec9-4492-a4fb-b68f1c89045e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.472528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 94/183] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/projects/303ef6eccb274f629ce5996890264b54 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.473707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a416-c520-4548-ae35-180973469331 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.473991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a416-c520-4548-ae35-180973469331 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.474274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a416-c520-4548-ae35-180973469331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.492219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2d48a416-c520-4548-ae35-180973469331 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:45.493225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d48a416-c520-4548-ae35-180973469331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:45.518664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587de280-320b-4daf-83ed-bada9716ed66 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.536399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.555568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.556233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.556511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.556783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.557620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:45.557926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.559614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.563753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 95/184] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:45.564606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48a416-c520-4548-ae35-180973469331 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.566683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 90/185] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=300694bf267d40f9898c40333aa080ec => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.566683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.663071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.710030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48a416-c520-4548-ae35-180973469331 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.715586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7cfe-fb3c-432a-b849-549483a6a6f9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.761606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.762585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.762739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.762998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.765760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.766086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.766371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.767732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.775760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:45.780450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:45.785315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:45.786273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:45.787061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 96/186] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:45.787781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f4b1be42-3337-43f5-a590-697ef83a8b33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:45.790160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:45.792255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 91/187] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:45.794566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67b7-9fd8-4370-887c-a1903fdfb695 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.796287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67b7-9fd8-4370-887c-a1903fdfb695 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.796287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67b7-9fd8-4370-887c-a1903fdfb695 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.796287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 92/188] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:45.797496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad67b7-9fd8-4370-887c-a1903fdfb695 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.849220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.917552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad67b7-9fd8-4370-887c-a1903fdfb695 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.918588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18abe8-cec2-4573-8b19-0362bf484125 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.953932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.954152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.954966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.955244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.955551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.956958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.958432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.960155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 93/189] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.960892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.968083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.968762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.969049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.969326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.970182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=303ef6eccb274f629ce5996890264b54, user.id=ccc514bd462946f1bf3425c214f1d782) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:45.970492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.972033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.979001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 97/190] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/role_assignments?user.id=ccc514bd462946f1bf3425c214f1d782&scope.project.id=303ef6eccb274f629ce5996890264b54&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.979683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.076800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251e42-3895-4f95-8e97-c856a6b79e10 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.091384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.100907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f2ba5-7b87-4d39-9b19-27053e34f790 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.120714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.121491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.121786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.122060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.122882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:46.123210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.124784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f951-5b24-40d7-8a2a-efb62a61a8ef None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.134567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 94/191] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:46.135941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab749-992e-456e-bb29-a95e36085beb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.136231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab749-992e-456e-bb29-a95e36085beb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.136515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab749-992e-456e-bb29-a95e36085beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.149467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.150168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.150467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.150736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.151523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:46.151831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.153314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.155645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-459ab749-992e-456e-bb29-a95e36085beb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:46.157547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-459ab749-992e-456e-bb29-a95e36085beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:46.168607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 98/192] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:46.168607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.239424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.245948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 95/193] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:46.248266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab749-992e-456e-bb29-a95e36085beb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.292008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4fdb3-97ee-4b57-8d95-a91fb25bfbec None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.332766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.333504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.333874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.334277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.335061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.336845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.358651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 99/194] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:46 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:46.359751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.360973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab749-992e-456e-bb29-a95e36085beb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.362607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.412756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.413657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.413934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.414202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.433351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.435077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.437114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 96/195] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:46.437746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.494197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b408-3a79-4424-b4d4-9b94a4e48ca0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.508196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.540089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.541004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.541282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.541584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.544130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.545237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.547019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 100/196] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:46.548202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.564260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6b17-c342-48b5-b1aa-19cf1f775fcd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.602380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.603123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.603434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.603705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.619556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:46.628586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:46.629660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:46.630438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:46.633537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 97/197] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:46.634674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.668494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.700609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e2e2-afde-45d9-96aa-b80f90bf018a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.749589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.750300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.750636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.750932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.779075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883094bb-c9f3-4dd2-ba0e-b405fe5235fa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.818688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.824976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.825655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.825936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.826341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.848042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.850530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.923410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.924941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.956506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:46.999744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 101/198] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:47.000916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.063445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 98/199] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:47.065229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.123845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.139921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caeac7-6f7c-494a-9db6-0ccba10ce024 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.178456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.179061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.179358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.179706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.180395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:47.180701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.182110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.191650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 102/200] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.192326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.200963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3621-3ed2-4458-b530-88fc2fb39f33 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.226741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.247009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.248362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.248960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.249500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.251869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.254278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.256941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 99/201] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.263348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.308129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d68e5-3b0a-4318-97c3-9b9a2dc909f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.344252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.345208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.345386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.345663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.347330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.348395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.350361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 103/202] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.350936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.363192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.390095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bc9d-f108-43c6-83a0-cb2c6ed9d7e9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.431080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.433067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.433548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.434064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] PATH_INFO: `/v3/users/0a580254d62149bb88ba67e22663c93d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.435687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] RBAC: Authorizing `identity:get_user(user_id=0a580254d62149bb88ba67e22663c93d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.437532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.440216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 100/203] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/users/0a580254d62149bb88ba67e22663c93d => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.441463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.459154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0e91-4fc0-40a4-9b5d-c87a25b84457 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.494830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.495654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.495842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.496123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.496984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=e5e2c6324e4347b5883131aafdfce80d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:47.497293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.498776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.505170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 104/204] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/role_assignments?user.id=e5e2c6324e4347b5883131aafdfce80d&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.505971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.509687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.600882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcf2d-9df7-4be8-a363-51b9a0ad20b2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.627731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.675931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804269-e524-4e9c-a2c1-41216c7b8a84 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.692268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.693528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.693811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.694081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.695380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=e5e2c6324e4347b5883131aafdfce80d) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:47.695994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.697751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.705679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 101/205] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/role_assignments?user.id=e5e2c6324e4347b5883131aafdfce80d&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=300694bf267d40f9898c40333aa080ec => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.735598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.736283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.736566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.736843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.813321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.814831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.894961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.931564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 105/206] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:47.937555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.058053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30499-a7a8-4450-b53b-5290c5cf1b7c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.083674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.100303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.101193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.101473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.101745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.108210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.109992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ecb2d-6b36-4ec1-8fc4-ff9c419cef69 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.112084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 102/207] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:48.117809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.281523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75666a-2bb0-4bc5-9006-c8b4630661fb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.338208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.339273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.339791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.340321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.341393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043, user.id=0a580254d62149bb88ba67e22663c93d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:48.341913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.343694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95636aa-da45-4911-a6e2-77d18df3d751 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.351221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 106/208] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:48 2022] GET /identity/v3/role_assignments?user.id=0a580254d62149bb88ba67e22663c93d&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=949ce506f27a40e69dcb774891841f16 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:48.968056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11183-d448-46d6-9eae-efdc1f92a8fc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.968579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11183-d448-46d6-9eae-efdc1f92a8fc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.968579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11183-d448-46d6-9eae-efdc1f92a8fc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.970033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 103/209] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:48.976517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.977002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.977075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.997870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af858c-52aa-4cc7-bd33-084255ae946c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.998250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af858c-52aa-4cc7-bd33-084255ae946c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.998415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af858c-52aa-4cc7-bd33-084255ae946c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.000056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 104/210] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:49.000619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:49.001914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:49.006707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.006974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.007251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.034686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:49.036058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:49.052362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.117813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 107/211] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:49.143326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 105/212] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:49.153357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.169721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.259731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e500c-b969-48e0-80be-9a47e5d3f4b1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.281122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386888c9-ebdf-4551-ae6f-1d03e4afded7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.296101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.296932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.297216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.297494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.300728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.309352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:49.317249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:49.318209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:49.318994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 108/213] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:49.324285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.324499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.325493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.325948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.326392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.327890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.329594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.331839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 106/214] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:49.338098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.363909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.441789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b4238-afce-42ec-9f5a-76d5892541c0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.450144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d1810-433f-4a62-87d9-0044431e755f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.479196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.479927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.480215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.480490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.481332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:49.481742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.483299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.487757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.488583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.488967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.489343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.490207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.491875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.492951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 109/215] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:49.498673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.515817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 107/216] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:49 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:49.611208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.634109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b238b4-37f3-4698-9b50-46f72d8fd676 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.681711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.682650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.682932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.683204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] PATH_INFO: `/v3/users/fe81fafb77d549cd880d4bdaf1f123c9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.699990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] RBAC: Authorizing `identity:get_user(user_id=fe81fafb77d549cd880d4bdaf1f123c9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.701665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca22b7-a41c-4faa-928c-8d34b969504d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.703994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 110/217] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/users/fe81fafb77d549cd880d4bdaf1f123c9 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:49.709548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.797408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.910950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f252ec8-c4bc-46ea-87ab-57175959c23a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.954779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.955902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.956392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.956866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.966648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc690ee-3972-4db7-9ac3-8ea54b714b5c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.967346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc690ee-3972-4db7-9ac3-8ea54b714b5c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.967820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc690ee-3972-4db7-9ac3-8ea54b714b5c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.969775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 111/218] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:49.975860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.976501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.976998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.002417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:50.004270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:50.081079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.082997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f43a-f8bf-4a82-87e0-35ba28e32c41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.096103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 112/219] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:50.118545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.195711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.204834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.231148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb9fb-cb3c-4794-bbd4-5105eea04094 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.269092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.270197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.270619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.271028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.283125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:50.291428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:50.292360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:50.293220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:50.295928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 113/220] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:50.308857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.340146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 108/221] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:50.340146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82708c1c-b563-4aa5-8e4b-5fea34533538 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.340146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82708c1c-b563-4aa5-8e4b-5fea34533538 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.340146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82708c1c-b563-4aa5-8e4b-5fea34533538 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.340146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 109/222] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:50.345442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82708c1c-b563-4aa5-8e4b-5fea34533538 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.447724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe304-2711-4f81-a01e-29405d6c344f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.475006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82708c1c-b563-4aa5-8e4b-5fea34533538 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.498533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.499682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.500422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.500937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.502319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:50.503016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.505023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d5c-1d3b-44b0-89c6-5f6bdc1f0700 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.509022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.523510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 114/223] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.525873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.526311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.526809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.538930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.540182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.540637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.541125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.542591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.544405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.551743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 110/224] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.553007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.560890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:50.563287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:50.568113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.699875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f73e-0ec7-45d3-ad92-aa3eaacdc218 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.707755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 115/225] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:50.709052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.742611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.744345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.744731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.745102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.746918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.749363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.751785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 111/226] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.756449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.852766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.861811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d1f3-067a-44b6-85f8-a4bc6c5ae014 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.886708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9a67-4d46-4659-b7a5-6d13e0bb8773 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.898167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.908984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.909680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.909965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.910244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.911096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=fe81fafb77d549cd880d4bdaf1f123c9) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:50.911433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.913542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.921144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 116/227] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/role_assignments?user.id=fe81fafb77d549cd880d4bdaf1f123c9&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.922180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.953309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.954149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.954428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.954697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.969951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:50.984140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:50.985678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:50.986998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:50.989995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 112/228] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:50.996607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.072130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161b0d2-bb96-4390-810b-1263828455cf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.123953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.124862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.125145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.125425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.126912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.128544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.130649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 117/229] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.136654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.198009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9240f-41b4-40bb-8ef2-5ec8a4780c7e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.212270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.260037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c324e8-fa08-41c9-be59-7bb38fdadb70 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.301693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.302628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.302915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.303192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/e5e2c6324e4347b5883131aafdfce80d/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.305814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.306508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.306787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.307061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.307884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:51.308193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.309774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.312205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, user_id=e5e2c6324e4347b5883131aafdfce80d, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.313735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.323230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.336837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 113/230] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:51.337182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 118/231] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:51 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/e5e2c6324e4347b5883131aafdfce80d/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:51.344621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.495904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827c0f-9162-45b3-81eb-3033f823a359 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.567162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.568111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.568393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.568675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.570008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.571552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.573586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 114/232] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.579855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.693647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b126e-d750-45bb-bb55-a661b0628591 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.715783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.731796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.732914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.733389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.733732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.735259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.736795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0364b-07ed-4b4b-b742-1525a407dd41 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.738807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 119/233] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.752563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.876089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.925179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83952-0804-41c2-9efa-85b9cf7fa33b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.962407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.963338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.963616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.963884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/e5e2c6324e4347b5883131aafdfce80d/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.966335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, user_id=e5e2c6324e4347b5883131aafdfce80d, role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.967856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816676f4-3d2a-4979-b35d-1b6ad33ce041 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.985406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 115/234] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:51 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/e5e2c6324e4347b5883131aafdfce80d/roles/300694bf267d40f9898c40333aa080ec => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:52.345686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204839d1-73f3-46a7-8fba-9a56ef1f44fe None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.346370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204839d1-73f3-46a7-8fba-9a56ef1f44fe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.346541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204839d1-73f3-46a7-8fba-9a56ef1f44fe None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.349132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 120/235] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:52.356010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90171c-b6d1-4e59-8b2a-aca1386a6842 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.356757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90171c-b6d1-4e59-8b2a-aca1386a6842 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.356757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90171c-b6d1-4e59-8b2a-aca1386a6842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.376434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0c90171c-b6d1-4e59-8b2a-aca1386a6842 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:52.377675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0c90171c-b6d1-4e59-8b2a-aca1386a6842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:52.450087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 116/236] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:52.485480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204839d1-73f3-46a7-8fba-9a56ef1f44fe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.619421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195be1-95a2-421b-a539-d7946f29b237 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.619728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195be1-95a2-421b-a539-d7946f29b237 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.620087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac195be1-95a2-421b-a539-d7946f29b237 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.621703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 117/237] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:52.625002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204839d1-73f3-46a7-8fba-9a56ef1f44fe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.633269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.633649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.633995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.671248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:52.672506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:52.696329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.697166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.697447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.697722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.720933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:52.735158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:52.736340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:52.737306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:52.737985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 121/238] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:52.745745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.779707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.806840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 118/239] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:52.844096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.873227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.953254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d57b2-3414-4a9d-87af-5da844d7a2ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.021048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.021756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.022031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.022305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.023066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:53.025519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.027022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.044234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 122/240] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:53.055279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.071978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3551eb9-5844-4886-9f73-ba24a0e17d01 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.114776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.115648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.115932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.116213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.120461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.122075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.127677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 119/241] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:53.134083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.255558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.261017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf1335-98f0-4582-9e9f-1aa1743fbd25 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.276478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.323446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.325328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.329096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.329414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] PATH_INFO: `/v3/users/30dfc8f19bd5476792d2c06d602edfd3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.357411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a83b89-1f94-4cf7-af3c-e03c885e9b57 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.360550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] RBAC: Authorizing `identity:get_user(user_id=30dfc8f19bd5476792d2c06d602edfd3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.362249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.364099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 123/242] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:53 2022] GET /identity/v3/users/30dfc8f19bd5476792d2c06d602edfd3 => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:53.372191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.415678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.416292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.416581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.416853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.417583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.419204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f943d60-c5ba-4c93-8fd9-d8109c0567a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.462200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 120/243] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:53 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:53.501391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cf11-2dcc-44ae-b3bc-3dba6502bc3d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.501710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cf11-2dcc-44ae-b3bc-3dba6502bc3d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.501948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873cf11-2dcc-44ae-b3bc-3dba6502bc3d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.503694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 121/244] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:53.510249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.510850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.511393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.536685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:53.537985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:53.592582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11e63-97cb-45c3-8ad4-bcb85cc7cfe6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.677202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 122/245] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:53.688892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.689912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.690204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.690486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.704200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.740194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.777696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.803487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.806887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.875443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06c77-10e5-4be8-86ac-d5b73c663a68 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.921016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.922461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.923337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.924294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.938427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:53.947831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:53.948792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:53.949658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:53.954116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 123/246] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:53.969464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.003234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 124/247] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:54.009652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.103337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.149819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e944f-3cee-4d71-901d-0c8d1db2b3de None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.198815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c22cb-7685-4d30-a75a-c5df0ebd3c86 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.201434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.201581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.202551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.202756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.203178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.206644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.208416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.210774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 125/248] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.216824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.245086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.246686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.247569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.248223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.249223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:54.249723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.252025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.264537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 124/249] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.271498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.400020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1aa48-005b-4ad7-8f1d-9156df0c641a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.414971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d9d1-78af-4dce-9038-968919f832f9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.447871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.449900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.450423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.451053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] PATH_INFO: `/v3/users/fe81fafb77d549cd880d4bdaf1f123c9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.453355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] RBAC: Authorizing `identity:get_user(user_id=fe81fafb77d549cd880d4bdaf1f123c9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.455624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d1281-5ab0-4163-9c86-b7cb243a78ab None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.457030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.457708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.457991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.458265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.458958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 125/250] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/users/fe81fafb77d549cd880d4bdaf1f123c9 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:54.459195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=30dfc8f19bd5476792d2c06d602edfd3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:54.463376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.463376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19e6d-90cd-4196-86e4-e9816090d2d7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.464481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.465987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afefc6-f2ae-4a1d-bde1-97fe2699d489 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.466752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afefc6-f2ae-4a1d-bde1-97fe2699d489 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.467226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afefc6-f2ae-4a1d-bde1-97fe2699d489 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.469509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 126/251] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:54.470462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 126/252] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/role_assignments?user.id=30dfc8f19bd5476792d2c06d602edfd3&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=949ce506f27a40e69dcb774891841f16 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.471495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afefc6-f2ae-4a1d-bde1-97fe2699d489 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.476360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f1df-0408-4c7c-96f9-6bb5c010b1d0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.476551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f1df-0408-4c7c-96f9-6bb5c010b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.483586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9f1df-0408-4c7c-96f9-6bb5c010b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.510474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ecf9f1df-0408-4c7c-96f9-6bb5c010b1d0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:54.512701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ecf9f1df-0408-4c7c-96f9-6bb5c010b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:54.518460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.604944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 127/253] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:54.606861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111753-fdd8-451b-9fee-ca2a0721bceb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.607454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111753-fdd8-451b-9fee-ca2a0721bceb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.607938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111753-fdd8-451b-9fee-ca2a0721bceb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.612961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 128/254] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:54.616083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afefc6-f2ae-4a1d-bde1-97fe2699d489 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.619584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.620231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.620707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.660717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:54.662007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:54.677097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.678150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.678491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.678915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.680765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.682724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.685927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 127/255] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.686659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.750485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 129/256] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:54.751464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.809750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.813800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc482-1fe3-4635-85b0-9de184915439 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.816569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.853411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.854227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.854511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.854788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.862380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafdca7-c836-449f-8810-53a00d32c23a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.866814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:54.877210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:54.878172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:54.880121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 128/257] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:54.887334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.939454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.940531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.940916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.941198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/fe81fafb77d549cd880d4bdaf1f123c9/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.943751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, user_id=fe81fafb77d549cd880d4bdaf1f123c9, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.952305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.993016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 130/258] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:54 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/fe81fafb77d549cd880d4bdaf1f123c9/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:54.994977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.998560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3572-bfe1-4d21-8827-8b6549cd8d40 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.040238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.040992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.041276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.041551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.055692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:55.065841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:55.068038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:55.069911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 129/259] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:55.081006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.126783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.264849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3743-4e22-4847-aa33-9c486dfffb9f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.313615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.317177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5353a-fcc5-4ae2-a6b2-49493372f08b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.353225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.353946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.354232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.354511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.355291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:55.356139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.358124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.379424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 131/260] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.389788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.390548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.390835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.391111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.391937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:55.392250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.393720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.402200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.409644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 130/261] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:55.417662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.592423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.627805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c204-c4a7-4d29-9e63-55b608b895ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.701805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.704573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.705242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.705878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.708947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.712185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.715414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 131/262] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:55.726159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.789354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c72be-c194-47dd-b05b-893c5c158e24 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.904256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.905434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.905857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.906268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] PATH_INFO: `/v3/users/e5e2c6324e4347b5883131aafdfce80d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.907822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e5e2c6324e4347b5883131aafdfce80d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.909547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.911808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 132/263] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/users/e5e2c6324e4347b5883131aafdfce80d => generated 283 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.917158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.952166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136f9a-d9f5-4509-b427-fefceb74459d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.996201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.996874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.997158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.997435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.040729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.046589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.138453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc341e-f646-429b-802d-c0196613c8b6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.181678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.182266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.182541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.182808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.193934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.195475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.368445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.369959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.409706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 132/264] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:56.422276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.482867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.497552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.575046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd566cd-dd7d-4324-a092-8c65e8694594 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.643561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.646805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.646805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.646805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.646805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.648509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.651340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 133/265] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.656628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.660662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 133/266] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:56.671176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.827055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc052a-bfe5-4f96-baa6-bedc7765153c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.838650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1eda-5b1f-4198-b6c4-3cb722e9551b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.880171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.881052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.881330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.881597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.883672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.883791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.885165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.890779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 134/267] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.893544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.921456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.922334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.923098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.923489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.925022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=e5e2c6324e4347b5883131aafdfce80d) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:56.927342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.929319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e197-cf4c-4687-a208-33ac7c064c71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.938983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.939170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 134/268] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/role_assignments?user.id=e5e2c6324e4347b5883131aafdfce80d&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=300694bf267d40f9898c40333aa080ec => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:57.038441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d29a7-5897-429a-9f28-59f816c1584a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.082941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.083668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.084036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.084315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.085183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=e5e2c6324e4347b5883131aafdfce80d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:57.085492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.087206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06d8e0-1c76-4087-8a01-9004b16e8d54 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.095505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 135/269] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/role_assignments?user.id=e5e2c6324e4347b5883131aafdfce80d&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:57.317167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a569-e4c3-416e-ad91-5b16deb305af None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.317575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a569-e4c3-416e-ad91-5b16deb305af None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.317752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a569-e4c3-416e-ad91-5b16deb305af None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.319181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 135/270] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:57.325365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8619-db7b-47da-8ad8-3ce42a42ce11 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.325993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8619-db7b-47da-8ad8-3ce42a42ce11 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.326469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8619-db7b-47da-8ad8-3ce42a42ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.349491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b75a8619-db7b-47da-8ad8-3ce42a42ce11 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:57.351183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b75a8619-db7b-47da-8ad8-3ce42a42ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:57.398204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab49e-777f-42e9-ab60-7e63436659bb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.398533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab49e-777f-42e9-ab60-7e63436659bb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.398775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab49e-777f-42e9-ab60-7e63436659bb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.400354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 136/271] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:57.409020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.409357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.409572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.430513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:57.435739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:57.479864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 136/272] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:57.490839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11a05-0d32-4499-a7c7-a973724a48cc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.490839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11a05-0d32-4499-a7c7-a973724a48cc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.490839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11a05-0d32-4499-a7c7-a973724a48cc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.490839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 137/273] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:57.497566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.497887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.498158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.520420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:57.521755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:57.532037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.533727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 137/274] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:57.534836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.620555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 138/275] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:57.621866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.660314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b26aa-1839-4c7a-ab32-20d3f6267258 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.674719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.697807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.698630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.698915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.699227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.700456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.701930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.703688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 138/276] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:57.704566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.734430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0bc5-125a-424c-9f10-2d44e6c1ff0e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.771648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.772558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.772841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.773230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.784090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:57.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:57.793307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:57.794116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 139/277] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:57.795459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.797262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.815783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ae1-3858-419a-af89-1d94308e9e2f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.850696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.851568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.851816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.852083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.862842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:57.870720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:57.871843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:10:57.872669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 139/278] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:57.873317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.906413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65830aa-4aa0-4539-963a-f2394914f19c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.921993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.949875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.951662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.952121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.952563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.953449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.955151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.981749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900c1e-c0c9-4990-9724-8988d260eabd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.987538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 140/279] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:57 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:57.987538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.051683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.055281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.056567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.056856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.058106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.059081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:58.059753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.061299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.075293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 140/280] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.081220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.111969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c012c7-776d-48f2-a942-7261fc394d36 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.150881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.151973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.152646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.153117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.154159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:58.154678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.156315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.166166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 141/281] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.172106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.197288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bd01e-78dd-42a2-8054-ee6ed8307d3e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.201539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.238722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.239661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.239935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.240217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] PATH_INFO: `/v3/users/d33725101fc740909785134c0987256b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.263754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] RBAC: Authorizing `identity:get_user(user_id=d33725101fc740909785134c0987256b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.265265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6823a-8faa-4fcf-826d-3498f0c4d248 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.271394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 141/282] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/users/d33725101fc740909785134c0987256b => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:58.273021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb893-467b-4163-ac3d-d9f5c38627d5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.273314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb893-467b-4163-ac3d-d9f5c38627d5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.273589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb893-467b-4163-ac3d-d9f5c38627d5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.275090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 142/283] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:58.278412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbb893-467b-4163-ac3d-d9f5c38627d5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.310073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efca2-d892-4568-a6f9-7b211fc12ddb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.333093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.357689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.358601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.358872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.359145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] PATH_INFO: `/v3/users/30dfc8f19bd5476792d2c06d602edfd3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.361373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] RBAC: Authorizing `identity:get_user(user_id=30dfc8f19bd5476792d2c06d602edfd3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.362201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d705280-9a40-4ec5-9305-47a64ee81c25 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.364176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 142/284] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/users/30dfc8f19bd5476792d2c06d602edfd3 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:58.365456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.365747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.366021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.387221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:58.389395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:58.405910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbb893-467b-4163-ac3d-d9f5c38627d5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.452695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.453489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.453648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.453903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.455037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, user.id=d33725101fc740909785134c0987256b, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:58.455379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.457142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.464087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 143/285] 10.222.0.82 () {56 vars in 1308 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/role_assignments?user.id=d33725101fc740909785134c0987256b&scope.system=all&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.465130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.485508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 143/286] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:58.515681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.527538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.659742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15405b0-e321-4de8-836d-6d43ce57697d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.694911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88690e44-8655-4bee-924b-cb56cff66697 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.706608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.707522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.707799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.708086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.709301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.711901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.713677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 144/287] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.720280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.742207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.743035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.743338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.743646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.755378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:58.763364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:58.764268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:10:58.765067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.765732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 144/288] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:58.772519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.836996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.847664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f4c22-519c-4630-9c2e-997be468b9fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.883015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.884420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.884899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.885378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/30dfc8f19bd5476792d2c06d602edfd3/roles/949ce506f27a40e69dcb774891841f16` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.887917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, user_id=30dfc8f19bd5476792d2c06d602edfd3, role_id=949ce506f27a40e69dcb774891841f16)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.889805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.906970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 145/289] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:58 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/users/30dfc8f19bd5476792d2c06d602edfd3/roles/949ce506f27a40e69dcb774891841f16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:59.012462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb487b5-2d02-4269-9d64-3d4b93d5193d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.063010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.063744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.064029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.064308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.065088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:59.065398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.066829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.076661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 145/290] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.082516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.206724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32961587-dc11-4dc3-8af0-78676c29237e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.249342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.250666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.251164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.251671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] PATH_INFO: `/v3/users/fe81fafb77d549cd880d4bdaf1f123c9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.253529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] RBAC: Authorizing `identity:get_user(user_id=fe81fafb77d549cd880d4bdaf1f123c9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.255275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.257769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 146/291] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/users/fe81fafb77d549cd880d4bdaf1f123c9 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.265213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.330507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.417556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f121a1a-d906-492c-bd39-1792b94f7bb2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.481303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.482511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.482988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.483498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.576025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.577883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.649015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.734404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 146/292] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:59.739990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.787729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.914658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08aeac-fbce-4ae4-9cf7-3ef335093844 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.957165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.958557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.959055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.959566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.961190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.963198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f5325-e016-4fc0-9cc1-0fecf06d03cb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.965840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 147/293] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.972862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.105342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44286-1bb6-4f1b-b6da-6431a2190455 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.146926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.147686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.147982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.148261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.149110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=fe81fafb77d549cd880d4bdaf1f123c9) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:00.149422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.150887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efd35a-3425-4621-b6c2-c6299b6ce358 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.161885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 147/294] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/role_assignments?user.id=fe81fafb77d549cd880d4bdaf1f123c9&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:00.490152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6762-6164-45a1-83a1-3f3a3d3dc3f9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.490854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6762-6164-45a1-83a1-3f3a3d3dc3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.491344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f6762-6164-45a1-83a1-3f3a3d3dc3f9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.493237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 148/295] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:00.498752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.499361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.499835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.506216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.520043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:00.521626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:00.599769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 148/296] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:00.626551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f6762-6164-45a1-83a1-3f3a3d3dc3f9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.733195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.748964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f6762-6164-45a1-83a1-3f3a3d3dc3f9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.790757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.791969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.792450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.792991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.805156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5b293397-4815-409b-bf4e-e33f225d28c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:00.813585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:00.814501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:00.815361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:00.817802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 149/297] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:00.824290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.908922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7841b-4be5-447e-8535-b3b0ed8cc4a0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.909557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7841b-4be5-447e-8535-b3b0ed8cc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.910232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7841b-4be5-447e-8535-b3b0ed8cc4a0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.912871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 150/298] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:00.918687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.918972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.919321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.936200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa7983-0bf9-442c-9cc1-e8c897883b80 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.937400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:00.938592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:00.977207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.977888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.978165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.978432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.979469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:00.979590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.981079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.987709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.991399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 149/299] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:00.997399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.022652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 151/300] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:01.044967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.118845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824b3e8-d8bb-46ec-bd0d-71fb87882dfe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.129676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.153372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3536df-96a7-4955-b51c-cb2fbb56e8a4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.160130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.161010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.161328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.161570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] PATH_INFO: `/v3/users/26629dc8f9a243d682a560bde19841b3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.176605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] RBAC: Authorizing `identity:get_user(user_id=26629dc8f9a243d682a560bde19841b3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.178562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76516e-87d6-4e85-ab7e-6413f916a155 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.180789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 150/301] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/users/26629dc8f9a243d682a560bde19841b3 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:01.181960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fa45-6869-48ca-8420-971dcc7aa759 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.182251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fa45-6869-48ca-8420-971dcc7aa759 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.182525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fa45-6869-48ca-8420-971dcc7aa759 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.184099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 151/302] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:01.188440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fa45-6869-48ca-8420-971dcc7aa759 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.197621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.198409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.198744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.198954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.200364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.202723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c752fba-579a-4ad7-a111-bb85093bb425 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.208788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 152/303] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:01.208788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.208788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.208788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.224345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:01.225510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:01.254811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.311448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 153/304] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:01.311448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.317990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fa45-6869-48ca-8420-971dcc7aa759 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.355150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.356003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.356345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.356667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.357587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, user.id=26629dc8f9a243d682a560bde19841b3, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:01.357962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.359560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.365131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 152/305] 10.222.0.82 () {56 vars in 1308 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/role_assignments?user.id=26629dc8f9a243d682a560bde19841b3&scope.system=all&role.id=949ce506f27a40e69dcb774891841f16 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:01.372570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.395767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.432724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5929abe-00e4-4d92-88e0-1c8b2cfcc327 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.470807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.471779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.472265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.472760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] PATH_INFO: `/v3/groups` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.473659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.475374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d97d-1742-4d84-bff2-7a780dc076bb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.493456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 154/306] 10.222.0.82 () {60 vars in 1134 bytes} [Wed Jul 20 19:11:01 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:01.519118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c836c2-debc-4067-ac1e-90cb10243687 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.544024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.569657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.570421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.570706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.571034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.579596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64eef5-6ae8-4830-9f7a-a88431998bd1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.580016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64eef5-6ae8-4830-9f7a-a88431998bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.580244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64eef5-6ae8-4830-9f7a-a88431998bd1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.581715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 155/307] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:01.584534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:01.588143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.588760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.589223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:01.593069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:01.594093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:01.594887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 153/308] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:01.601114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.611735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:01.613356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:01.708557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 156/309] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:01.727925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4f9d-d2b9-40bd-93e8-a2ac6192f49e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.732520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.768725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.769457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.769740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.770259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.771664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:01.771987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.773417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.790080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 154/310] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:01.792278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.814068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.855774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.860129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d93cf-53dc-4bd2-a295-77ddab9f8d23 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.897206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.897830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.898178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.898541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.910541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:01.919201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:01.920243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:01.921033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:01.926138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 157/311] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:01.927134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.936314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eb6-09e3-4b94-9027-b3b3b8dadd19 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.985753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.987510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.988343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.988788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] PATH_INFO: `/v3/users/d33725101fc740909785134c0987256b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.990840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] RBAC: Authorizing `identity:get_user(user_id=d33725101fc740909785134c0987256b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.993000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.995621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 155/312] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/users/d33725101fc740909785134c0987256b => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:02.002181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:02.045498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e16c2-5072-49bc-bdda-6aa75f1e4424 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.075971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:02.086438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.087388 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.087841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.088259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.089157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:02.089601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.091415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.101579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 158/313] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:02.107403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:02.116820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ba50c-4cb8-4318-9570-13fdac836336 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.126298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:02.153559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.154709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.155120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.155519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] PATH_INFO: `/v3/system/users/d33725101fc740909785134c0987256b/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.157392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d33725101fc740909785134c0987256b, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.158931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.175470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 156/314] 10.222.0.82 () {58 vars in 1334 bytes} [Wed Jul 20 19:11:02 2022] PUT /identity/v3/system/users/d33725101fc740909785134c0987256b/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:02.223423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c5a5-7f95-47b2-8b38-5e0482b5ee6d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.264747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.265918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.266343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.266784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] PATH_INFO: `/v3/users/30dfc8f19bd5476792d2c06d602edfd3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.268405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] RBAC: Authorizing `identity:get_user(user_id=30dfc8f19bd5476792d2c06d602edfd3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.270079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.272012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 159/315] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:02 2022] GET /identity/v3/users/30dfc8f19bd5476792d2c06d602edfd3 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:02.280561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:02.408619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbef9d-0717-4585-9224-d0f1efa7f15c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.445857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.446812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.447259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.447736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.491710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:02.521101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.522950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.628898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 157/316] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:02.634481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:02.704727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:02.764585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c8c68-7d78-4045-b2e4-fc0add7c250b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.805820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.806698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.806972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.807240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.808489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.809999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a5eb0-7fe4-4962-8284-16722e126892 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.812118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 160/317] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:02 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:02.817687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:02.887793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:02.920076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfec8e-be3c-4e0a-acfc-fc6cfbeed3e7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:02.960322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:02.960899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:02.961178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:02.961449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:02.962290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3, user.id=30dfc8f19bd5476792d2c06d602edfd3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:02.962598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:02.964083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa093-022e-4a05-9293-f4cb2c2ce18d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:02.970949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 158/318] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:02 2022] GET /identity/v3/role_assignments?user.id=30dfc8f19bd5476792d2c06d602edfd3&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=949ce506f27a40e69dcb774891841f16 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:03.511725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e207-e62e-409e-aab8-2150d61c9f42 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.512285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e207-e62e-409e-aab8-2150d61c9f42 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.512285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e207-e62e-409e-aab8-2150d61c9f42 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.513676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 161/319] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:03.519433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659de3-3203-4e87-8c48-9b7d358ec31b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.520049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659de3-3203-4e87-8c48-9b7d358ec31b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.520049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659de3-3203-4e87-8c48-9b7d358ec31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.537919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-59659de3-3203-4e87-8c48-9b7d358ec31b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:03.539103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-59659de3-3203-4e87-8c48-9b7d358ec31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:03.612548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 159/320] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:03.634640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e207-e62e-409e-aab8-2150d61c9f42 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:03.748782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e207-e62e-409e-aab8-2150d61c9f42 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:03.755136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f14a7-b899-4a31-8647-a6a43457d2c4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.755452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f14a7-b899-4a31-8647-a6a43457d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.755729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f14a7-b899-4a31-8647-a6a43457d2c4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.757288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 160/321] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:03.762617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.762873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.763120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.783182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:03.783813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:03.784514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:03.798607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:03.799455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.799738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.800010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.811539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:03.822938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:03.824598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:03.825672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 162/322] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:03.831057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:03.864633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:03.879768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 161/323] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:03.897283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:03.948781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491edd-5c49-47d7-aed7-2e568ea7fb8b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:03.991131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:03.991799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.992078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.992352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.993110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:03.993411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:03.994836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.004784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 163/324] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:04.010888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.014455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf298f5-8971-44bd-aef3-c721bfd52fba None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.054689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.056137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.056137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.056137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.057974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.059226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.065576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 162/325] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:04.066769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.067940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.126931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b047bf-c3f1-48a9-9851-1632f6da0726 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.138956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.167851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.168640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.168912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.169174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] PATH_INFO: `/v3/users/26629dc8f9a243d682a560bde19841b3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.170441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] RBAC: Authorizing `identity:get_user(user_id=26629dc8f9a243d682a560bde19841b3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.172039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.174204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 164/326] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/users/26629dc8f9a243d682a560bde19841b3 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:04.180013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.183868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f139-8876-4e25-a7ce-3df5675d386c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.222490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.223183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.223510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.223767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] PATH_INFO: `/v3/groups` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.224480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.226288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fa8b1-e453-4f35-b808-7c3cbffc2b9e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.251359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 163/327] 10.222.0.82 () {60 vars in 1134 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:04.297268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa143d-2c5f-4382-96eb-be0bf249dacf None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.297848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa143d-2c5f-4382-96eb-be0bf249dacf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.298074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa143d-2c5f-4382-96eb-be0bf249dacf None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.299762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 164/328] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:04.305509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.305855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.306065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.313119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a8e4-dc5b-4588-aa40-1aff813cded1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.324924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:04.326223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:04.336145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.367259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.368268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.368612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.368934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] PATH_INFO: `/v3/system/users/26629dc8f9a243d682a560bde19841b3/roles/949ce506f27a40e69dcb774891841f16` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.370617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26629dc8f9a243d682a560bde19841b3, role_id=949ce506f27a40e69dcb774891841f16)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.372184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.385690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 165/329] 10.222.0.82 () {58 vars in 1334 bytes} [Wed Jul 20 19:11:04 2022] PUT /identity/v3/system/users/26629dc8f9a243d682a560bde19841b3/roles/949ce506f27a40e69dcb774891841f16 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:11:04.432960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 165/330] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:04.460289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.594559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b918cc-700b-4403-b19f-93ef648360eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.639531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.640358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.640638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.640908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.653939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:04.661908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:04.662850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:04.663670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 166/331] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:04.670627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.745421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.807105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21deeb-81a3-4a83-af5a-b5e106650885 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.864455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.865569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.866062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.866512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.867904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:04.868472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.871160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.889324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 166/332] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:04.895292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.963443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.100794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013d72e-9c2c-4661-8211-40f892aa0c28 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.152143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.153033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.153358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.153639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] PATH_INFO: `/v3/users/d33725101fc740909785134c0987256b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.155025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] RBAC: Authorizing `identity:get_user(user_id=d33725101fc740909785134c0987256b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.156586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439212-ac06-40fb-bce4-5520b7d694cb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.158662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 167/333] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/users/d33725101fc740909785134c0987256b => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:05.164834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.293459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c351-8bf6-4710-b74a-243530171f8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.313997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.335183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.335884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.336163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.336434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.337270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] RBAC: Adding query filter params (role.id=401c11587dd645d8a09a0c7acb2df8c2, user.id=d33725101fc740909785134c0987256b, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:05.337578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.339089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d196-9343-40ff-9918-e7157c822eeb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.354893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 167/334] 10.222.0.82 () {56 vars in 1308 bytes} [Wed Jul 20 19:11:05 2022] GET /identity/v3/role_assignments?user.id=d33725101fc740909785134c0987256b&scope.system=all&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:06.892400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0d67-a999-44d3-9595-9437fb2b2441 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:06.892983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0d67-a999-44d3-9595-9437fb2b2441 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:06.892983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0d67-a999-44d3-9595-9437fb2b2441 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:06.894658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 168/335] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:06.905778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea80cf-662d-4fcf-b774-3026a6c44076 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:06.906302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea80cf-662d-4fcf-b774-3026a6c44076 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:06.906302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea80cf-662d-4fcf-b774-3026a6c44076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:06.928922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-edea80cf-662d-4fcf-b774-3026a6c44076 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:06.930159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-edea80cf-662d-4fcf-b774-3026a6c44076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:07.041876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 168/336] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:07.107259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0d67-a999-44d3-9595-9437fb2b2441 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.156676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee767b-03f3-4969-9d5d-95f183b3d75c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.157076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee767b-03f3-4969-9d5d-95f183b3d75c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.157517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee767b-03f3-4969-9d5d-95f183b3d75c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.168724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 169/337] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:07.175571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.176121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.176585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.214196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:07.216282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:07.242121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0d67-a999-44d3-9595-9437fb2b2441 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.255643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.337707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:07.338547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.338830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.339105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.375030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 170/338] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:07.375880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:07.384214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:07.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:07.386107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 169/339] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:07.392592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.432529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.462584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.622520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09e2f8-465c-4b50-88b5-454a7aa44547 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.665108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:07.665927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.666382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.666794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.668662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da942c-57f4-459b-bdba-87582a4a3a7d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.683780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9b8ba6e8-3379-4af2-886f-cd5d6b3573ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:07.692499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:07.693537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:11:07.694327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:07.698519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 170/340] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:07.700549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82c13-7aee-49e3-b4a6-df5939a1c80d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.701055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82c13-7aee-49e3-b4a6-df5939a1c80d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.701560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82c13-7aee-49e3-b4a6-df5939a1c80d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.703599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 171/341] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:07.704648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f82c13-7aee-49e3-b4a6-df5939a1c80d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.739695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.804080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:07.805181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.805673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.806177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.807154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:07.807692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:07.809383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068f45f-27e7-4349-acaa-efdafbd1d000 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:07.826020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f82c13-7aee-49e3-b4a6-df5939a1c80d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.833380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 171/342] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:07.835069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.835607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.836104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.865583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:07.866264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.866745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.867167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.868283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:07.868876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:07.870597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:07.876396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:07.877752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:07.881246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 172/343] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:07.883986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.984927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.999464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179f78-55ef-40c3-b403-2dc657bc1178 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.021890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 172/344] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:08.022572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.040095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.041023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.041510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.041943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.075675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.121669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.123650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.224332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.239094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 173/345] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:08.240212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.241726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72d0c-d9b1-4e41-82f6-dcec985f3f57 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.337898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.340034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.340859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.341652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] PATH_INFO: `/v3/users/26629dc8f9a243d682a560bde19841b3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.345940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] RBAC: Authorizing `identity:get_user(user_id=26629dc8f9a243d682a560bde19841b3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.349360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.353653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 173/346] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/users/26629dc8f9a243d682a560bde19841b3 => generated 293 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.354756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.384138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8be3-88f2-4509-b19d-1049b7ae79af None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.463918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.465985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.466268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.466542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.491111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:08.500916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:08.502644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:08.505094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:08.509088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 174/347] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:08.510906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.580841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.587322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.601297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d80f-4086-4e0b-b6ec-2283f7e17e15 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.681326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.682718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.683219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.683743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.685229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.687096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.687547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd203-6c1b-4c8e-b596-da8eef9d9c16 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.689558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 174/348] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.690366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.742233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.742827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.743099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.743501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.744460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] RBAC: Adding query filter params (role.id=949ce506f27a40e69dcb774891841f16, user.id=26629dc8f9a243d682a560bde19841b3, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.744768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.746585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadff6a-a09d-48ca-be1a-e4c5fefa3dd9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.769137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 175/349] 10.222.0.82 () {56 vars in 1308 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/role_assignments?user.id=26629dc8f9a243d682a560bde19841b3&scope.system=all&role.id=949ce506f27a40e69dcb774891841f16 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.771790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d718-97e7-4688-bf9b-a179ec29c069 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.771790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d718-97e7-4688-bf9b-a179ec29c069 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.771790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d718-97e7-4688-bf9b-a179ec29c069 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.772830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 176/350] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:08.773503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0d718-97e7-4688-bf9b-a179ec29c069 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.838536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd47e3-8bc1-4e30-bd54-8950bbed2789 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.882872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.884014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.884523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.885128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.886210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.886799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.888695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba0c1-cf4f-4f10-ab8f-be2e8f531e87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.899442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 175/351] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.901069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0d718-97e7-4688-bf9b-a179ec29c069 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.901539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.902096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.902619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.909780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.923798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:08.925535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:08.945067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.946053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.946391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.946677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.949828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.954783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.956594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.958889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 177/352] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.959828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.045017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 176/353] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:09.046730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.083931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd18d-fa00-445a-91b5-6768a6ff7e0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.126367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.127097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.127433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.127743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.178548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.225468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.227017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9e19c-2b48-48c4-9f9b-e24bc73c6130 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.273712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46587a3a-f768-49de-a8da-eddcd7e65bef None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.316930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.317532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.317871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.318090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.319730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:09.319730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.320830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.327898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 177/354] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.328842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.360999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.379029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 178/355] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:09.383674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef055f-45ff-48a0-854c-55b6eb67adda None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.383674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef055f-45ff-48a0-854c-55b6eb67adda None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.383674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef055f-45ff-48a0-854c-55b6eb67adda None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.383674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 179/356] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:09.388253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdbcb-e6c7-4f42-bd23-ac163c358a79 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.388539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdbcb-e6c7-4f42-bd23-ac163c358a79 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.388813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdbcb-e6c7-4f42-bd23-ac163c358a79 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.391984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 180/357] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:09.393455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.393750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.394032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.414761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:09.416099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:09.509143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d7ed-5c27-4a56-8373-ab24f6fe6c9c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.522365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.527568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 181/358] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:09.529520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.564846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.565684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.565967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.566240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.583443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4f034f6a-66c8-4334-bb83-7da8eefa04f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:09.589762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.590733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:09.592045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 178/359] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.592900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.593046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.593319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.617060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:09.618848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:09.689379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0660ddc-3321-490d-9f1d-b676506de1a3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.717991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 179/360] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:09.718842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.735141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.738951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.739847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.740144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.740418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.742118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.743889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.746315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 182/361] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.747213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.842976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.872833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a15c96-78fc-4416-b294-597cf4da0263 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.902419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045efd6-5e25-46c9-9d62-30ba415eb9c6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.932914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.936805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.936805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.936805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.955682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:09.960145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.962020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.962300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.962576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.963369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:09.963684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.966150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:09.967058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.968869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:09.969662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:09.971187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 180/362] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.971187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.981057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 183/363] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.981960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.097841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.138039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513c00-77a4-4664-8b82-cca28f226a8d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.163280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea192c3c-d343-4a1c-a9b9-b9cdaf18bc2a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.186133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.202319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.204219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.204508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.204788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.206092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.207804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.209678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 184/364] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.210491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.216575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.217427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.217744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.217970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.234540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:10.242724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:10.243761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:10.244801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 181/365] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:10.245477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.406689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e55e9-6a05-4307-a951-7bede1862863 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.424042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465388f-e931-4965-adef-1d4a5bd5cc8f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.465049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.469786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.470601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.470974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.471280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.472200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.472639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.474331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.474797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.475528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.477150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.477651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.487469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 185/366] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.489147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.581409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.607479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.608909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.670307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd3a8f-d8d7-4c09-9b56-7aad9843cf6a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.726884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.729623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.730644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.731710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.733825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.734570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.736566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.749617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 186/367] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=300694bf267d40f9898c40333aa080ec => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.749617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.796308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 182/368] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:10.797873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.846109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.903986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113276f-ec5f-4608-9a04-6dbcdd05441b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.932517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.945996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.946697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.946975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.947249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.948074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.948385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.949898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.960955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 187/369] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.961846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.998052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5f49-d832-4d10-bd4e-e484f6e9600e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.067107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.068294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.068793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.069294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.092599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a76ee-027f-40b4-91b3-d34de306e05b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.141627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.144115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.144801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.146366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.148699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.152582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.156906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 188/370] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.159209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.207383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.209784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.243043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.252463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.303042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28361-0596-43de-9fb0-9352143125c2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.354950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 183/371] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:11.359335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.359335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.359335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.359335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.361194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.443069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.445030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.510559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b970-7572-47c7-acd2-735ab134b9ed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.526578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.552994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.567450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.568556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.568839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.569114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.570697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.572386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.578737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 184/372] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.578737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.593894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 189/373] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:11.595428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.729901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9365a-c43a-4c01-b9b1-6ec9d8fe7fde None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.746586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45838-33f7-4d7a-b035-4ad3bf30dab0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.795843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.796419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.796574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.796739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.796968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.797690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.798053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.798195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.798325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.798479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.799989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5b951-4dde-4e46-8ee6-cc8a63b49112 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.800264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.806278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.809648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 185/374] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.813365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.814723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 190/375] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.817525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89f74-a684-4943-a780-6b0333fd25f5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.817974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89f74-a684-4943-a780-6b0333fd25f5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.818401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89f74-a684-4943-a780-6b0333fd25f5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.821257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 191/376] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:11.822514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89f74-a684-4943-a780-6b0333fd25f5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.860659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.903813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.953211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d6bb-d78d-40f4-9c58-4685556460a6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.977456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89f74-a684-4943-a780-6b0333fd25f5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.996510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.997730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.998008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.998399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] PATH_INFO: `/v3/projects/8244e79834fb42488dc5fd64702925b0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.999881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] RBAC: Authorizing `identity:get_project(project_id=8244e79834fb42488dc5fd64702925b0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.001403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a27e-5402-416c-89bb-73133944fef3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.007547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 186/377] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects/8244e79834fb42488dc5fd64702925b0 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.009223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.009505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.009780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.022806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.024693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.024979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.025246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.027000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.029328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.030801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:12.031573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 192/378] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.032080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:12.032342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.137835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 187/379] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:12.139095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.195850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.199538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aded88-d444-48a7-af41-c66ae680c2d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.235225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.251715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.252643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.252914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.253244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] PATH_INFO: `/v3/groups/79b745cd1d3b458f94a20d80ba7724ee` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.259443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] RBAC: Authorizing `identity:get_group(group_id=79b745cd1d3b458f94a20d80ba7724ee)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.260979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.269308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 193/380] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/groups/79b745cd1d3b458f94a20d80ba7724ee => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.270319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.283521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5536818-8279-4c3d-a74d-594c91646cbd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.330509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.331528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.332335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.332622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.333841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.334161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.336358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.344734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 188/381] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=300694bf267d40f9898c40333aa080ec => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.345694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.484157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a062d9-faf5-4efa-aae7-87e6c8631a0f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.487340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634f49b-096f-4ff8-9e76-53955371effe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.522197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.531617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.532304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.532587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.532889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.533712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] RBAC: Adding query filter params (group.id=79b745cd1d3b458f94a20d80ba7724ee, role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=8244e79834fb42488dc5fd64702925b0) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.534062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.535557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.542228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 189/382] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/role_assignments?group.id=79b745cd1d3b458f94a20d80ba7724ee&scope.project.id=8244e79834fb42488dc5fd64702925b0&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.544431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.545277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.545557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.545829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.559815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:12.567937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:12.569065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:12.569890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 194/383] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:12.577870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.736993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471696c-4f31-44ec-8336-487e12c93a28 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.782219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.782910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.783190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.783493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.784257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.784560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.785986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.796554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 190/384] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.804510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.824734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.939106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c081300-42bf-458d-a6dc-d4d8ad66baad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.976835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.977770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.978128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.978491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.980367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.982069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.984000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 195/385] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.990109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.060935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.153344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcac4-1ca4-423b-892f-8b60b3a6a716 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.215922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.217432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.217795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.218233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.220356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.223047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50056-0f69-498a-9a1d-ee41e9aa3dd8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.226479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 191/386] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:13.232689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.369332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.396087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb881a95-1aeb-4a7d-bb26-c3b57f35bf2f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.449106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.450032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.450317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.450589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/groups/f331dca95d1b475691b84af4cd67bf08/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.452691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, group_id=f331dca95d1b475691b84af4cd67bf08, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.454188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ab7c-f7ea-4d68-a906-0981c2d3f075 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.469027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 196/387] 10.222.0.82 () {58 vars in 1442 bytes} [Wed Jul 20 19:11:13 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/groups/f331dca95d1b475691b84af4cd67bf08/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:13.618676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c894-7dc8-4186-8ea1-603a176e93a6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.619723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c894-7dc8-4186-8ea1-603a176e93a6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.620176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c894-7dc8-4186-8ea1-603a176e93a6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.622596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 192/388] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:13.629343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.629986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.630459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.651380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:13.652671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:13.743401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 197/389] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:13.760632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c894-7dc8-4186-8ea1-603a176e93a6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.877729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c894-7dc8-4186-8ea1-603a176e93a6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.901111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.917596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.918836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.919361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.919895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.932178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:13.941338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:13.942326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:13.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:13.951099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 193/390] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:13.952970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.040597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.090222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c8b5-0221-4870-8e94-3a9bed2e2027 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.138108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.138718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.139000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.139274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.140068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:14.140374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.141783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.155452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 198/391] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:14.161478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.326783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c66592-4b41-417e-b007-46bdb1fecdc8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.378595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.379751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.380206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.380489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.381734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.383276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.385545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 194/392] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:14.394529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.523482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51816749-0d2d-4c6e-bce5-4ad40326db53 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.561200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.575025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.575953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.576226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.576496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.577759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.579240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cecf72-1f8b-477e-9b73-bd93148cbb69 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.581014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 199/393] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:14.586916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.603214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7ef1-d388-4291-9bfd-6ebbc1c88b52 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.603648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7ef1-d388-4291-9bfd-6ebbc1c88b52 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.603800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7ef1-d388-4291-9bfd-6ebbc1c88b52 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.605639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 200/394] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:14.612478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.612845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.613078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.636767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:14.637967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:14.697454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.773631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 201/395] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:14.777194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f4e9-6533-4977-aa38-b3925db009b2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.806812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.812967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.813904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.814170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.814444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/groups/f331dca95d1b475691b84af4cd67bf08/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.817911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7e95a26e4a1e8c79f59547e20043, group_id=f331dca95d1b475691b84af4cd67bf08, role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.819431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.835253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 195/396] 10.222.0.82 () {58 vars in 1442 bytes} [Wed Jul 20 19:11:14 2022] PUT /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043/groups/f331dca95d1b475691b84af4cd67bf08/roles/300694bf267d40f9898c40333aa080ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:11:14.939296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46abcb-f0e6-487d-b728-3f0d0f69f9e5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.975706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.977935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.978783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.979253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.979458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.991765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:14.999935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:15.000936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:15.001734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 202/397] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:15.007212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.124471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0494-cea0-41b5-a516-7a4498802417 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.135829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.165786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.166487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.166769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.167064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.168192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:15.168495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.170248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.180881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 196/398] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:15.186525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.300226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754eeb5-3202-4130-874c-027de3b81ff4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.336664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.337559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.337862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.338134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.339482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.341089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.343110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 203/399] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:15.349769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.463224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cde2d-1680-4405-aef6-f1770929d43b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.499659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.500572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.500846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.501115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.502315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.503840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4276b-82e2-4eff-b4e9-b7cb417d460e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.505880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 197/400] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:15.512401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.537810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfcee5-afa1-478c-9869-eca1756d1c42 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.538141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfcee5-afa1-478c-9869-eca1756d1c42 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.538356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfcee5-afa1-478c-9869-eca1756d1c42 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.540114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 198/401] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:15.550007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.550357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.550558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.586697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:15.589862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:15.618984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.664582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.716865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e9928-ccc4-475c-b2ba-a7c20fe8bf1f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.744065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 199/402] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:15.768640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.769823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.770131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.770402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/groups/f331dca95d1b475691b84af4cd67bf08/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.773397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, group_id=f331dca95d1b475691b84af4cd67bf08, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.774906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce143b6-662e-42f1-8464-605afda9c8a8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.800553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.801796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 204/403] 10.222.0.82 () {58 vars in 1442 bytes} [Wed Jul 20 19:11:15 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/groups/f331dca95d1b475691b84af4cd67bf08/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:15.859450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434681ff-212e-4dd1-adf6-2271bd39f47d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.859742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434681ff-212e-4dd1-adf6-2271bd39f47d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.860019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434681ff-212e-4dd1-adf6-2271bd39f47d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.861659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 205/404] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:15.867957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e61ef-b731-468c-b4df-6ed83d15aabd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.868556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e61ef-b731-468c-b4df-6ed83d15aabd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.869068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e61ef-b731-468c-b4df-6ed83d15aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.887837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c34e61ef-b731-468c-b4df-6ed83d15aabd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:15.889631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c34e61ef-b731-468c-b4df-6ed83d15aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:16.030865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54774587-a047-4ed2-9ea2-0343efe1ae1f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.079855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 206/405] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:16.096704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe969-f110-4f65-ab0e-acffb6685347 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.097193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe969-f110-4f65-ab0e-acffb6685347 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.097703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe969-f110-4f65-ab0e-acffb6685347 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.100849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 207/406] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:16.105394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe969-f110-4f65-ab0e-acffb6685347 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.115421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.116733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.117220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.117669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.130691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-53479d0a-1305-4236-a8eb-f5ccda19d6f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:16.139751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.140701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:16.141503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:16.144503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 200/407] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.146118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.146585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.147044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.165530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:16.167051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:16.209604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.219752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.279861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe969-f110-4f65-ab0e-acffb6685347 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.292909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 201/408] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:16.294131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.366804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.368355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.368887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.370254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.397269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:16.408671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.410037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:16.411148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:16.415409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 208/409] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.417769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.440115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7906c8-7515-4132-b085-d0ead98b37a1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.509192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.510361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.510845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.511396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.512852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.513398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.516108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.535496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 202/410] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.537862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.591022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.622479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bc85-26df-4c9e-931b-d923cbd41260 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.636011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.676080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.676958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.677469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.677817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.697442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:16.710198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.712000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 209/411] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.714809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.774578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f99ef2-541c-40bf-80e9-448aa00c3b52 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.839215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.840504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.840999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.841476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.842846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.843450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.846073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.868020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 203/412] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.870784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.921787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264f0b-1540-46fe-a81b-f0016777c1c3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.973546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.974923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.975469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.975964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.978163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.980289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.982916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 210/413] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.988694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.026253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.031492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.064189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982784b0-3d7b-440b-8be5-31bf047d9265 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.120025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4e2c-b0f9-40d0-bc4a-157361bc452e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.127542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.129683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.129683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.129683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.130827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.131341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.133844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.151190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 204/414] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.152749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.197836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.199845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.200581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.201233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] PATH_INFO: `/v3/groups/79b745cd1d3b458f94a20d80ba7724ee` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.203753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] RBAC: Authorizing `identity:get_group(group_id=79b745cd1d3b458f94a20d80ba7724ee)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.206861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.210472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 211/415] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/groups/79b745cd1d3b458f94a20d80ba7724ee => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.212375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.322459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8bc52-e92e-4ed1-a1ac-0a0de60e1817 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.363465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.365357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.365357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.365357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.366939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.368468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.377463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 205/416] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.377463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.395416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.415410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc613092-a1f1-4e45-a3f7-3fc5faa78e26 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.417417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.461679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.462736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.463268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.463770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.498565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbaada-74ec-4a38-a955-ca42d5b0a15c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.562909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.564517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.565001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.565520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] PATH_INFO: `/v3/projects/8244e79834fb42488dc5fd64702925b0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.567776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] RBAC: Authorizing `identity:get_project(project_id=8244e79834fb42488dc5fd64702925b0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.570721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.574152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 206/417] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects/8244e79834fb42488dc5fd64702925b0 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.575411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.582205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.583773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4ff31-f6ae-419f-bc49-69baeb208b99 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.729352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 212/418] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:17.731878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6627-4fbc-44ce-a3a3-f69f71285640 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.732333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6627-4fbc-44ce-a3a3-f69f71285640 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.732718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6627-4fbc-44ce-a3a3-f69f71285640 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.738505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 213/419] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:17.738505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6627-4fbc-44ce-a3a3-f69f71285640 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.738880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.742330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.769652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f50f-33c8-46f4-b81d-9b223b9a5e92 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.832256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.833295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.833425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.833979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/groups/f331dca95d1b475691b84af4cd67bf08/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.836121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] RBAC: Authorizing `identity:create_grant(project_id=c91f3a1bc28340d1a899c685212d7fc3, group_id=f331dca95d1b475691b84af4cd67bf08, role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.837610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.853248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 207/420] 10.222.0.82 () {58 vars in 1442 bytes} [Wed Jul 20 19:11:17 2022] PUT /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3/groups/f331dca95d1b475691b84af4cd67bf08/roles/300694bf267d40f9898c40333aa080ec => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:17.854076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.938388 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6627-4fbc-44ce-a3a3-f69f71285640 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.008270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.009978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.010521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.011051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] PATH_INFO: `/v3/projects/8244e79834fb42488dc5fd64702925b0/groups/79b745cd1d3b458f94a20d80ba7724ee/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.015154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] RBAC: Authorizing `identity:create_grant(project_id=8244e79834fb42488dc5fd64702925b0, group_id=79b745cd1d3b458f94a20d80ba7724ee, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.018178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f76690-4463-4b12-9fa9-3c2c47aedb77 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.037856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b1a3-09e1-4b52-8645-b8a50f91ae1d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.048862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 214/421] 10.222.0.82 () {58 vars in 1442 bytes} [Wed Jul 20 19:11:17 2022] PUT /identity/v3/projects/8244e79834fb42488dc5fd64702925b0/groups/79b745cd1d3b458f94a20d80ba7724ee/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:18.050960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257b69-9c00-44c5-9444-0a932467f2c2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.051378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257b69-9c00-44c5-9444-0a932467f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.051934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257b69-9c00-44c5-9444-0a932467f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.085646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b8257b69-9c00-44c5-9444-0a932467f2c2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:18.088349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b8257b69-9c00-44c5-9444-0a932467f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:18.123159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.124143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.124426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.124762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.126209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.127912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.130267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 208/422] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.136495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.152862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.194702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.215111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 215/423] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:18.216731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeadc9b-8795-4c77-bac9-c86c470d971e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.217017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeadc9b-8795-4c77-bac9-c86c470d971e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.217443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeadc9b-8795-4c77-bac9-c86c470d971e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.219167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 216/424] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:18.225311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.225599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.225928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.245905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:18.247584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:18.304060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd40d2-468e-487c-87f5-1f1d6a3c288a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.353283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.354184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.354460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.354854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.356258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.358194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.360549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 209/425] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:18.361451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.373512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 217/426] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:18.375501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.476824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.506999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd50ff-de54-45a9-9ce8-57e3c8fbe31c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.538095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f159-8f93-450f-bdcc-34abc1f9cc1c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.549257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.549953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.550237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.550506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.564103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:18.571262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:18.573768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:18.574777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:18.575981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:18.580179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 210/427] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:18.581325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.590187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.591428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.591936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.592401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.593568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:18.594095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.596051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.603938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 218/428] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.605239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.749668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f90b8-aafd-42a3-9915-630b1f552df1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.815863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f842-62c2-4099-8672-a95179fff09d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.836843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.838166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.838716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.839231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.840856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:18.841409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.852528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.880647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.882443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.883149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.883636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.887062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 219/429] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.889715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.897041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.907900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:18.937019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:18.939002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:18.940638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 211/430] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:18.950677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.024615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.130555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a49f5-48ed-44b9-b9b8-0ebbfa5f943d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.184398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.185091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.185374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.185653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.197020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18755a7f-0130-42b1-b009-520a17690ea4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.248582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.250027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.250655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.251293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.253146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.253908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.260032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.278867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 212/431] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:19.285034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.291235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.293390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.387619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.412180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.484220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 220/432] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:19.491261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.491739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4ce9-efd2-4108-b630-da9bbfc8d069 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.544608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.545917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.546229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.546479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.652473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.654537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.695251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cee70-3650-4510-9c52-d3b1ef3d235f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.749419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.750830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.751762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.751912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] PATH_INFO: `/v3/projects/a71a7e95a26e4a1e8c79f59547e20043` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.753447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] RBAC: Authorizing `identity:get_project(project_id=a71a7e95a26e4a1e8c79f59547e20043)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.757848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.761469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 221/433] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/projects/a71a7e95a26e4a1e8c79f59547e20043 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:19.776018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.781186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.818010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.864806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 213/434] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:19.874006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.962582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff77b-ee6c-45a9-832a-e2fb68ead818 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.029174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.030346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2083713-85fc-4742-8d27-2b2f2bc5afe9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.033098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.034484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.035695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.038362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.041692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.044673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 222/435] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.051879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.080080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.081158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.081444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.081718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.083160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.084703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.087520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 214/436] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.092991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.131251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.192694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.214309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fa2d7-579a-45aa-9f03-590da0b5ef95 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.234564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a8a60-1d23-4847-a97a-e151a735a2e7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.262612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.264130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.265058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.265599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.267471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=a71a7e95a26e4a1e8c79f59547e20043) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:20.268428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.271891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.276780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.277715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.277996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.278264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.279915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.281408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187e121-8ab6-4266-b702-4a59ba755ca7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.282410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 223/437] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=a71a7e95a26e4a1e8c79f59547e20043&role.id=300694bf267d40f9898c40333aa080ec => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.283344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 215/438] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:20.294906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.375055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d821-f2dc-4f1a-8dfe-56d01e342621 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.375525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d821-f2dc-4f1a-8dfe-56d01e342621 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.375665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d821-f2dc-4f1a-8dfe-56d01e342621 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.377364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 216/439] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:20.386485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69981-024a-484d-8566-b8405e46f7b1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.386984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69981-024a-484d-8566-b8405e46f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.387512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69981-024a-484d-8566-b8405e46f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.416684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-80b69981-024a-484d-8566-b8405e46f7b1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:20.418955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-80b69981-024a-484d-8566-b8405e46f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:20.440563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cac05-2b91-414e-862f-aae0d30b92eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.495297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.495984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.496265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.496537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.497398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=401c11587dd645d8a09a0c7acb2df8c2, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:20.497698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.499185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84b33-882d-479f-91f5-2ba835f4fd4d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.513961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 224/440] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=401c11587dd645d8a09a0c7acb2df8c2 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.547989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 217/441] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:20.550578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0ec5-8597-4f3e-9a79-6474331667b9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.550872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0ec5-8597-4f3e-9a79-6474331667b9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.551149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0ec5-8597-4f3e-9a79-6474331667b9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.552901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 225/442] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:20.561001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.561615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.562032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.576409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0ec5-8597-4f3e-9a79-6474331667b9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.581461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:20.583035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:20.606751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.620976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.709097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 218/443] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:20.747764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.755538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0ec5-8597-4f3e-9a79-6474331667b9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.812627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.813544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.813826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.814170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.827288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:20.836520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:20.837682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:20.838730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 226/444] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:20.846556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.915712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a160e-a9e9-4546-b842-7e5218fee1be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.952028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.970392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.971590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.971880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.972155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.987534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:20.995641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:20.996725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:20.997528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 219/445] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.003832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149800-be88-4860-883e-bdbbeb0b4969 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.006110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.030468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.051910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.052601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.052889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.053161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.053963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.054268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.055744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.066512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 227/446] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:21.071891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.158150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02eac9-0fc3-4dcb-8aee-b211cec4f3b0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.203004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135621a-a9c9-4929-981e-7804a05e5e50 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.218476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.219176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.219504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.219791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.220580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.220886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.222335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.231967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 220/447] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:21.237999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.252465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.253196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.253446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.253777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.257204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.344143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.345658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.355914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.395812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c35f0-e512-47fb-bbec-9769d40c1d9f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.437750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.438535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.438822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.439099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.503556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 228/448] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:11:21.509836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.547960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.548665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.551453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.636013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd690-efe6-4727-b914-134905dcf45c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.656335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.675619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.676495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.676776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.677050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] PATH_INFO: `/v3/projects/c91f3a1bc28340d1a899c685212d7fc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.678354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=c91f3a1bc28340d1a899c685212d7fc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.679932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.681779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 229/449] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/projects/c91f3a1bc28340d1a899c685212d7fc3 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.682817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 221/450] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:11:21.687769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.688840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.797961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5811-1008-40c5-86bb-cd4037b24cb8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.799717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.814362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310eb-123f-4584-a008-c8f6428ddbaa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.840675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.841762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.842038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.842301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] PATH_INFO: `/v3/groups/f331dca95d1b475691b84af4cd67bf08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.843629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] RBAC: Authorizing `identity:get_group(group_id=f331dca95d1b475691b84af4cd67bf08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.845201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.846932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 230/451] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/groups/f331dca95d1b475691b84af4cd67bf08 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.853211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.855581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.856636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.856980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.857362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] PATH_INFO: `/v3/projects/8244e79834fb42488dc5fd64702925b0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.858836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] RBAC: Authorizing `identity:get_project(project_id=8244e79834fb42488dc5fd64702925b0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.860576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.862434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 222/452] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/projects/8244e79834fb42488dc5fd64702925b0 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:21.869000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.927909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.977124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435e10-b52e-4eb5-a264-c80561c231c9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.997259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bce2d4-b1fa-44b6-af20-ac0a6c60f82a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.016572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.017241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.017520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.017791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.018631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] RBAC: Adding query filter params (group.id=f331dca95d1b475691b84af4cd67bf08, role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=c91f3a1bc28340d1a899c685212d7fc3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:22.018939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.020519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.027243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 231/453] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/role_assignments?group.id=f331dca95d1b475691b84af4cd67bf08&scope.project.id=c91f3a1bc28340d1a899c685212d7fc3&role.id=300694bf267d40f9898c40333aa080ec => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:22.055767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.056988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.057410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.057827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] PATH_INFO: `/v3/groups/79b745cd1d3b458f94a20d80ba7724ee` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.059883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] RBAC: Authorizing `identity:get_group(group_id=79b745cd1d3b458f94a20d80ba7724ee)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.062254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a0f9c-5762-488e-8c2a-32d4f76e42c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.065072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 223/454] 10.222.0.82 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/groups/79b745cd1d3b458f94a20d80ba7724ee => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:22.074194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.127647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.241064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f8d7c-b493-4bff-841a-0cfd29b07a0c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.288783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.289864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.290330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.290778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.292155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] RBAC: Adding query filter params (group.id=79b745cd1d3b458f94a20d80ba7724ee, role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=8244e79834fb42488dc5fd64702925b0) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:22.292539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.294281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e175991-816a-40d9-9d04-2f1f8faa8589 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.301964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 232/455] 10.222.0.82 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/role_assignments?group.id=79b745cd1d3b458f94a20d80ba7724ee&scope.project.id=8244e79834fb42488dc5fd64702925b0&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.009472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ad54-6371-4259-9022-1aa781cff4f5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.010007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ad54-6371-4259-9022-1aa781cff4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.010007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ad54-6371-4259-9022-1aa781cff4f5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.011845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 224/456] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:25.018335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40096ba3-334b-41a0-b1e6-ec16758711bd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.018976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40096ba3-334b-41a0-b1e6-ec16758711bd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.019384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40096ba3-334b-41a0-b1e6-ec16758711bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.048675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-40096ba3-334b-41a0-b1e6-ec16758711bd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:25.050326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-40096ba3-334b-41a0-b1e6-ec16758711bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:25.160593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 233/457] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:25.202291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ad54-6371-4259-9022-1aa781cff4f5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.352744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ad54-6371-4259-9022-1aa781cff4f5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.368155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.385083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088f99-a737-4d10-b373-4fcfba076445 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.385686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088f99-a737-4d10-b373-4fcfba076445 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.386259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088f99-a737-4d10-b373-4fcfba076445 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.388189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 234/458] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:25.401451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.403204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.403930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.404071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.404343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.404709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.405027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.424101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.425750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.442130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:25.444670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5803a526-0dbe-4441-9e1e-680968c76a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:25.450500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.451599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.452448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:25.452448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:25.452448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.452448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:25.452448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 225/459] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.453759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5725ff-3f2d-4e1c-955e-53f6ac0a7646 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.454241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5725ff-3f2d-4e1c-955e-53f6ac0a7646 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.454713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5725ff-3f2d-4e1c-955e-53f6ac0a7646 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.456594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 226/460] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:25.462739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.463050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.463592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.477987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.483271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:25.484620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:25.533604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 235/461] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:25.534482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.565563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 227/462] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:25.575595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.678664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a4613-420f-4da8-95cb-cf35ca57adc4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.691931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345700d-6c59-4a30-9d72-701c28aa4ab0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.695657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.721280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.722244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.722496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.722841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.724244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:25.724592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.726633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.737214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.738213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.738496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.738771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.744721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 236/463] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.744721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.755930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.757493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.766440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e7a67fa6-a928-4c65-a918-b4a8dcf0709a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:25.777001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.778237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 228/464] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612ed2-d1e6-4ec2-ba6b-160820877461 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612ed2-d1e6-4ec2-ba6b-160820877461 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612ed2-d1e6-4ec2-ba6b-160820877461 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.784298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 229/465] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:25.784784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f612ed2-d1e6-4ec2-ba6b-160820877461 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.869247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807832-681e-42b2-a28e-b28ee2c9938a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.905392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.906119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.906413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.906684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.917116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f612ed2-d1e6-4ec2-ba6b-160820877461 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.918260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.919776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:25.938312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.939278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.940199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:25.940199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:25.940199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.940199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:25.940199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 237/466] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.944170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.965149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.966243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.966588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.967060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.968205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.969698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3ffa-375e-42dc-9f21-68dfa3815129 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.994162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 230/467] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:25.995672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.996006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.996289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.014802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.017176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:26.019069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:26.049415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.096538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc024ce5-c01a-490b-a5c0-49bbc43a38f5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.106768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 231/468] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:26.108158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.161297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.161890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.162168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.162437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.163177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.163639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.165194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.186704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 238/469] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.187807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.238629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755a98-a6d0-42c4-b1de-39893e170a23 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.275917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.282566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.283363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.283629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.283903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.284636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.284995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.286397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.300887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 232/470] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.303681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.309981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abcc5-b1c8-4a13-91cd-991656e72b8b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.342173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.350230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.351202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.351628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.352170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.365501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.367621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:26.391661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:26.392768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:26.393729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:26.393729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:26.393729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.393729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:26.393729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 239/471] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:26.394832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.446246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f01cd0-4f30-4df1-b8e5-02add7acd2a9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.492224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.493485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.493908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.494477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.496282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.497966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.526732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 233/472] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:26 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:26.528325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.532387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1520999-e4b7-4060-9814-85ba6ef38b70 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.601296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.602255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.603233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.603674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.604044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.608747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.610175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.657086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 240/473] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:26 2022] POST /identity/v3/users => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:26.679957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238a910-4f35-4e0e-8c72-3280d13328eb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.723677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.724761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.725243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.725658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.726616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.727085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.728810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99303-2654-4b28-a49c-f6a3d1ec57a8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.744890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 234/474] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.750503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.787322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc097c-e74e-4fc7-801b-416e2c6098e1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.787843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc097c-e74e-4fc7-801b-416e2c6098e1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.788257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc097c-e74e-4fc7-801b-416e2c6098e1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.790543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 235/475] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:26.798522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.799503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.800001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.813403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.832775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:26.833717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:26.905415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81ab4-de08-4756-ad3c-ddbe8af01925 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.940110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 236/476] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:26.949464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.950141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.950493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.950856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.951793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.953284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.967170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.983417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 241/477] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:26 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:27.023013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.098955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be57b6e-b8a8-40cc-9cad-d89479db3d07 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.147962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.148653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.148929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.149200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.149961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.151397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.171394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:27.171394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:11:27.171394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [parameters: {'id': 'd91cc477990d4dabb929def06ba7e365', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:11:27.171394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:27.193276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:27.194213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:11:27.195134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:11:27.196003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:27.196871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:27.197683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'id': 'd91cc477990d4dabb929def06ba7e365', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:27.198460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:11:27.201524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:27.203426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 237/478] 10.222.0.82 () {60 vars in 1131 bytes} [Wed Jul 20 19:11:26 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:27.209771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.321930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.328747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee809-8331-46aa-afe4-a2842969a2a9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.363967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.364795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.365073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.365345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.377626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-dc5fb41d-8a5a-4bd3-a8b9-ec3eda42490a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:27.385852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:27.388022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:27.389798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 242/479] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:27.398035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.518825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70ceb2-51f2-4157-9ff4-6da5a1b82f18 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.520448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.556614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.557300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.557593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.557852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.558690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:27.559050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.560490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb784e-1f30-4a50-b597-635fb19103bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.569753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 238/480] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.380242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d28cf-9a79-4146-8f1d-995d5b297b17 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.380853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d28cf-9a79-4146-8f1d-995d5b297b17 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.380853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d28cf-9a79-4146-8f1d-995d5b297b17 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.382406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 243/481] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:28.388019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.388445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.388580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.408732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:28.409953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:28.496145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 239/482] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:28.532290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d28cf-9a79-4146-8f1d-995d5b297b17 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.692601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d28cf-9a79-4146-8f1d-995d5b297b17 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.758234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.759632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.760128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.760606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.779990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:28.794894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:28.796651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:28.798559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 244/483] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:28.807047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.993037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.004270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0af310-d5e0-424b-8bf5-ed319a071b74 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.063406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.064551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.065024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.065493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.066839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:29.067398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.069940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d52a-a2e5-4840-a3fc-170481a846d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.085718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 240/484] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:29.094792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.129572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.278207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c3f3e-0985-44ca-b5ac-761b180f8a2b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.278638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c3f3e-0985-44ca-b5ac-761b180f8a2b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.279104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c3f3e-0985-44ca-b5ac-761b180f8a2b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.281162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238e852-70f7-4f4e-9c72-7fc5ac4b009f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.282113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 241/485] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:29.288414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22da48-ea9d-46e8-a6bc-92b90a0be6f5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.288997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22da48-ea9d-46e8-a6bc-92b90a0be6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.289491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22da48-ea9d-46e8-a6bc-92b90a0be6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.332321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8d22da48-ea9d-46e8-a6bc-92b90a0be6f5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:29.333862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8d22da48-ea9d-46e8-a6bc-92b90a0be6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:29.340834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.342160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.342652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.343146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.362157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.365218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:29.402016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:29.403380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:29.404231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:29.404231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:29.404231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:29.404231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:29.404909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 245/486] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:29.413931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.502871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 242/487] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:29.505535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8278-5219-48d3-a633-10914b1a02a5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.506158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8278-5219-48d3-a633-10914b1a02a5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.506643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8278-5219-48d3-a633-10914b1a02a5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.509208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 243/488] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:29.509664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.516082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.516550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.517007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.549245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:29.551126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1de95-2ca3-443d-beee-b9b3e4cb154d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.551256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:29.590827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.591554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.591836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.592108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.592858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:29.593169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.594589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.610953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 246/489] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:29.612317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.710404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 244/490] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:29.712450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.749926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.761402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1356-5f21-45fb-94e5-5e634e02636b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.799756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.810738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.811832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.812116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.812391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.826740 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:29.837107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:29.838261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:29.839285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 247/491] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:29.839996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.852336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79497-2e40-44df-9b37-c4901dcf8b14 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.889697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.890793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.891242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.891671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.900209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.902107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:29.920203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:29.921347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:29.922731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:29.929570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 245/492] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:29.930693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.966089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec98-d9b2-49df-9633-399bf09f36e1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.010235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.011099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.011412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.011689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.015869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.027897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:30.038700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:30.039889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:30.040775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:30.043387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 248/493] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:30.044523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.052633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939a96-15ce-49ea-9f94-e5a6da2d4f27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.097101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.097667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.098361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.098782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.098954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.099703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.100052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.101470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.110787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 246/494] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.111687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.168418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce175cc7-6a18-49de-aeb6-a65e912f3dc3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.205890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.206563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.207185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.207185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.208336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.208336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.209761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.242880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c47fa-00d8-4ce1-a806-dd9a96665f7c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.252752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 249/495] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.252752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.288491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.289178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.289436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.289708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.290462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.290765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.292240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7ca6-91c4-493a-887d-95cfe2b756a0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.298570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.302317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 247/496] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.303747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0523-c17a-4ac6-8e13-2d8cfec0df5c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.304413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0523-c17a-4ac6-8e13-2d8cfec0df5c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.305040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0523-c17a-4ac6-8e13-2d8cfec0df5c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.306793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 248/497] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:30.308261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c0523-c17a-4ac6-8e13-2d8cfec0df5c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.365607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ddae-e96b-4600-93d8-07af1cd74d87 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.369138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.404751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.405565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.405828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.406098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.416907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.418408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.420456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c0523-c17a-4ac6-8e13-2d8cfec0df5c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:30.436640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:30.437559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:30.438510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:30.438510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:30.438510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.438510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:30.438510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 250/498] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:30.438781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.461351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.462050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.462326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.462655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.531984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.534350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.536052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.549526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65adb4-cda9-49c4-84ef-6e9deac9777d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.596996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.597796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.598549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.598820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.613597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.615906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d6ec0c7-1c65-43bb-bc0e-747e22048d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:30.636734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:30.637835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 251/499] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffa31-fc4e-490f-9ac1-b33c66e8111e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffa31-fc4e-490f-9ac1-b33c66e8111e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.643683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffa31-fc4e-490f-9ac1-b33c66e8111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.658962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-086ffa31-fc4e-490f-9ac1-b33c66e8111e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:30.660507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-086ffa31-fc4e-490f-9ac1-b33c66e8111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:30.662381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.666633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 249/500] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:30.667534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 252/501] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f01d-a212-4e0d-a1b2-15d728140457 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f01d-a212-4e0d-a1b2-15d728140457 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f01d-a212-4e0d-a1b2-15d728140457 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 253/502] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:30.756141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f01d-a212-4e0d-a1b2-15d728140457 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.807668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.812517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847e44-1537-465e-8915-14af1c5d7d92 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.864113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.864764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.865052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.865314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.866082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.866391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.867843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.878992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f01d-a212-4e0d-a1b2-15d728140457 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.884041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 250/503] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.884876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.929092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.929844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.930124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.930450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.931343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.931637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.933111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ca66d-17ee-421d-915f-3f4ff8cf4a5a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.940718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.953576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 254/504] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.953576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.953576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.953576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.974645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:30.976252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:31.017105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4184-887d-440e-af46-c145bd0f1512 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.049061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 255/505] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:31.049918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.052939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.054574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.054852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.055141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.067518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.069016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:31.086878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.087844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.088690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:31.088690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:31.088690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:31.088690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:31.088690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 251/506] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.088957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.104769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.158810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf787cc-9021-4190-82d4-ca151736e116 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.185180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.193862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.194670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.194948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.195215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.195324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e5b9-9334-4265-ae0f-99ec50f1711b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.206621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:31.214457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.215387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:31.216234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 256/507] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.216915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.229339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.230187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.230461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.230727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.238873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.240390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:31.254920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.256057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 252/508] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.257292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.322807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718ea78-cbfa-43fc-80c2-28c70bb781a5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.333115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.357846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.358657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.358929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.359199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.364195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083920-e15b-4eec-a15f-ab9dfa55a676 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.367728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.369206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:31.385266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.386186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:31.387083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 257/509] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.387792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.403737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.404556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.404838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.405114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.416154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.417581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:31.434818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.435726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.436560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:31.436560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:31.436560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:31.436560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:31.436560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 253/510] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.436836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.437458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.491573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb6340-c880-49d2-b280-eb674717cd15 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.524794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.525603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.525882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.526150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.526901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.527202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.528660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.541323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 258/511] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.541581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2de63-653a-431b-8410-da139541cc17 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.542189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.568818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.580195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.580877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.581160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.581435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.582210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.582513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.583955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.593075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 254/512] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.595236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.645859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0650-5ed9-4f5d-8bad-76e054113148 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.655932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.682236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.682976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.683245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.683591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.684505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.684942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.686504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.703642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 259/513] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.704444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.710336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de912-c897-4e36-802a-ee68107b7a68 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.746941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.747542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.747820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.748087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.748941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.749248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.750697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.790177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 255/514] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.791018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.815073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf09-0079-4ee6-b87d-e715c7d0a432 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.838340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.849680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.850345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.850623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.850891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.851644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.851947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.853331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.865048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 260/515] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.865852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.893501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.896344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adce17-9e69-4901-bfa7-d7bc6623b07f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.934816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.935603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.935879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.936144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.943249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.944753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:31.959497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.960427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:31.961329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 256/516] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:31.961786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.972538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48b493-c65f-49b7-9c1b-258ebeac0fbe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.009340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.010138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.010421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.010697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.022460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.024034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:32.042967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:32.044676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 261/517] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:32.045835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.090319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5da5-00ee-46da-b67a-3a637fcb897e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.094950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.133182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.133840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.134135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.134396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.138936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.166237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665f53e-f848-4ebe-a46b-18cf5eb125b3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.202252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.202905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.203181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.203488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.211736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.213222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.273761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.275267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.318067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 257/518] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:32.318911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.325814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.357159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.380518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 262/519] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:32.381364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.429695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d1f1-775b-4e2f-9105-b4ef5888fe67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.463348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.463949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.464226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.464498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.465198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.466764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.481328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d296d9-463c-4f2c-ac14-c32df2030034 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.487730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 258/520] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:32 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:32.488544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.519265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.519977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.520280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.520570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.521342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:32.521655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.523201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.543904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 263/521] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.544445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.577785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.606564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.633514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58d89d-fe0c-4410-b8c3-4a8b5c6e8931 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.678912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.679657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.679938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.680217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.681044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:32.681569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.682872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.695716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 259/522] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.701753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.704409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34631-f830-4602-83d1-e999567afa2c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.751803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.752964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.753431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.753859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.765628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.767738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:32.792502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:32.793606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:32.794792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:32.794792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:32.794792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.794792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:32.796561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 264/523] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:32.797860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.816278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d2d-ee5b-4679-8365-1ef3dbe56ed6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.840148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.858509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.859347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.859636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.859910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.873256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.874745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:32.893476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:32.894448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:32.895290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:32.895290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:32.895290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:32.895290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:32.895290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 260/524] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:32.895607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.902856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.913242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f0c47-837b-472e-aa9e-81eabcb324b6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.949613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.950373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.950715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.951056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.952000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=6c159e59080a41d2b1857c89c6e4c442) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:32.952383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.953925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.960069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 265/525] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/role_assignments?user.id=6c159e59080a41d2b1857c89c6e4c442&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.960983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.023624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b6d4-8c1f-431f-9615-90b99a988f68 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.065249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.066240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.066619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.066993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.076093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.077762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:33.094116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.095269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:33.096409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:33.099048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5035-ccfc-445e-8929-776b17d28983 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.103334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 261/526] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.104433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.142615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.150123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.151188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.151625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.155662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.156579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.157597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.159643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.176709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 266/527] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.177958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.207724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.228692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d210a-0b07-4561-84bf-59e9213f41b9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.287106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.288286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.289216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.289640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.290809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.291268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.293732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.315613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 262/528] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.315613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.318419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0642-2967-44a0-a023-85ff8186aff8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.357589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.358440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.358822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.359219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.360284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.360935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.362296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.387750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 267/529] 10.222.0.82 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.388805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.436743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.448892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6345e-1e32-475f-988a-cdb01068350f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.487783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.488700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.489784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.490273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.490768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.498826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.500665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.515863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ccda-cc3b-485e-b359-96d7224bda71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:33.516508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.517329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:33.518182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:33.520770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 263/530] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.521924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.554722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.555769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.555878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.556093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.564415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.565945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:33.582522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.583476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:33.584328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:33.587680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 268/531] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.588681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.646904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa69f-4a36-4c4c-af48-cd4854375585 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.702177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.703200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.703647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.704177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.727883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.738997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c2ae-c324-4793-9a41-bafec56d292a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.778926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.783077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.785059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.786364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.787040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.787334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.787642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.788440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.788942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.791338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.807571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 269/532] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.808877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.932485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a354-78d2-46a1-bb6d-6fc3947f4e73 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.937179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 264/533] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:33.937958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.975794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.976855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.977328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.977839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.978958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.979495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.981330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.000209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 270/534] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:34.001620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.012963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.081134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.093989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e3ae-0878-4ed4-8013-2935d7ca501f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.141136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.141870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.142152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.142426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.143649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=4bacfdb698cf41dfb6be9a0e94daf371) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:34.143997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.146255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.154518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ed03-ce67-4288-9d13-803439691a5d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.155029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 265/535] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/role_assignments?user.id=4bacfdb698cf41dfb6be9a0e94daf371&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:34.155932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.271217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.272081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.272362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.272638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.286230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.287818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.305752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71898d47-ee7b-4e7d-a1e6-2abca8d99d8f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:34.309519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:34.310446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:34.311340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:34.311340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:34.311340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.311340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:34.315472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 271/536] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:34.317074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.328646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.368473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.369092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.369373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.369647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.370575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:34.370894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.373895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.389112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 266/537] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:34.500234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee2e4-34d2-4868-ab0e-297ff6ac15f3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.508748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.560709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.561411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.561696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.561976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.562854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:34.563167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.564655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe298-ce8c-49ff-b067-a22f408f1d1e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.586759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 272/538] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:34.592683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.724655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20611db-1e84-4cf7-81d9-19a9b8ca4c86 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.741442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175adfe-3832-4d77-b22a-8c9ebba07b20 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.742154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175adfe-3832-4d77-b22a-8c9ebba07b20 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.742661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175adfe-3832-4d77-b22a-8c9ebba07b20 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.744840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 273/539] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:34.751235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.751892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.752361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.781810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.783052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.783589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.784128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.787471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:34.788705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:34.793087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.794934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:34.811278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:34.812247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:34.813098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:34.815792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 267/540] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:34.828462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.913898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.915342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 274/541] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:34.965249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.006550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14361355-50f4-46d5-a421-9f9c7450090f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.059943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.060626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.060906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.061182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.061980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.062286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.066278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.109947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 268/542] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.117468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.154683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.158161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c0af-f740-43b3-afcb-cdcb22305684 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.197475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.198402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.198687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.198966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.211722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:35.219942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.220909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:35.221725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 275/543] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:35.227584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.305446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.310895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e32bfe-aaf6-425f-b8d7-359d914a666d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.353943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.354658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.354940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.355607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.356167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=e626b6c267034377a800d89dd1a40bd7) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.356477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.358071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3b053-1a87-46d7-941b-d18ac67b6089 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.365181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 269/544] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/role_assignments?user.id=e626b6c267034377a800d89dd1a40bd7&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.366596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7ae5-c2fe-426e-a3af-6e7e05313efb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.366879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7ae5-c2fe-426e-a3af-6e7e05313efb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.367175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7ae5-c2fe-426e-a3af-6e7e05313efb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.368800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 270/545] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:35.375032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.375032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.375373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.385892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a28f05-b2ca-40bb-b41c-f8e5db247e63 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.393102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:35.394379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:35.435615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.436850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.437307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.438060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.440021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.440335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.441836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.456686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 276/546] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.468526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.493568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 271/547] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:35.506805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.555361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.691225 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf41d1-5a32-4b00-b4d9-deafaec99961 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.772203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.773274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.773692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.774122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.789135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.804624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.806261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b2136-748e-454c-bff7-ac5e91ee9d4e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.806597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:35.852141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.853150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.854112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:35.854112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:35.854112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:35.854112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:35.856196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 277/548] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:35.861624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.894470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.895318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.895607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.895881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.919277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:35.935722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.937202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:35.939108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:35.945647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 272/549] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:35.952598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.017559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.091748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc161-193b-48cf-8618-3ef7a20acd40 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.142179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9f87-b85a-49ca-aa18-d991b1ed988a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.157070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82346-f414-4391-b126-191afb91101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.158211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82346-f414-4391-b126-191afb91101c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.158683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82346-f414-4391-b126-191afb91101c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.159171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82346-f414-4391-b126-191afb91101c None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.160237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef82346-f414-4391-b126-191afb91101c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.160752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef82346-f414-4391-b126-191afb91101c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.162413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef82346-f414-4391-b126-191afb91101c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.176923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 278/550] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.184039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82346-f414-4391-b126-191afb91101c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.210479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.211174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.211482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.211753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.213448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.214035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.215511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.238876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 273/551] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:36.243361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.278633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.418478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82346-f414-4391-b126-191afb91101c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.467991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88487340-3d28-4629-952f-f78ee2cc19ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.482372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.498663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.500126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.501627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.502968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.521755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.524512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:36.543514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:36.544765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:36.545739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:36.549509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 279/552] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:36.556503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.564304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.565537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.571566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.572221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.596354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.598240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:36.632603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:36.633581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:36.634551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:36.634551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:36.634551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:36.634551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:36.647365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 274/553] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:36.654206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.778567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a71d3f-fc39-44aa-91a5-8de4ec0a608c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.802024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.850766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.851878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.853029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.853524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.854856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.856538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.858983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.872368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33d68-c91d-47f4-8f31-ff6e3e157302 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.894250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 280/554] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:36.905680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.929479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.930678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.931186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.931735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.932726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.933248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.934974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.950485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 275/555] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.960598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.008001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.083093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1a2b-eed1-433e-b929-6e69a20aa7ff None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.116968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108293c-180c-45c7-b946-183a70bb50a4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.119975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.120765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.121045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.121320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.146925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.156166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.157087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.157364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.157723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.167158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.168774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b37977d5-5c73-42ca-9979-96330b150600 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:37.185640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.187180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 276/556] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.188468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331133-3a9b-48cf-bc8f-bcf31c8a31d9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.189118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331133-3a9b-48cf-bc8f-bcf31c8a31d9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.189118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331133-3a9b-48cf-bc8f-bcf31c8a31d9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.190212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 277/557] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:37.195512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147db0-8ffb-4359-afcd-877941ce9754 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.195891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147db0-8ffb-4359-afcd-877941ce9754 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.196173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147db0-8ffb-4359-afcd-877941ce9754 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.197473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 278/558] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:37.198155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147db0-8ffb-4359-afcd-877941ce9754 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.205811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.207351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217492-0cb1-4cc1-840c-dfbcf4cff1f0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.257274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.310776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147db0-8ffb-4359-afcd-877941ce9754 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.334271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 281/559] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:37.335657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.335947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.336238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.348109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.348793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.349064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.349335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.350171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.350471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.351958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d12e-b80e-42ce-9006-12cc964e0600 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.353554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:37.355420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:37.371330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 279/560] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.372758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.373045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.373316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.390431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:37.391641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:37.437051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.447540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 282/561] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:37.447540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.475376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 280/562] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:37.476236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.533379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.559216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d50cfb-17b7-4db0-9e97-f9d37bbaec7a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.594409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611a36-feb7-4f45-b45b-6c967293a9d3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.596662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.597477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.597754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.598032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.609550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.611028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:37.639421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.640450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.641354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:37.641354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:37.641354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:37.641354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:37.641354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 283/563] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.647061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.649230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.650414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.650693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.650967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.663206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.664908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:37.686939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.688034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.688938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:37.688938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:37.688938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:37.688938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:37.688938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 281/564] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.689828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.721094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.759931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54dc6b-d78f-4070-92ac-ca747f20277f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.786693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.794856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.795147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee9ac-658e-4d95-83e4-ebc65b765384 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.795721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.796001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.796276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.808966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:37.816762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.817747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:37.818619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 284/565] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.819426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.831723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.832624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.832909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.833168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.843452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:37.851098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.852178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 282/566] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.853011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.924750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef3f04-eec1-428b-82b5-20bcac865161 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.941562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.955286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64e79-28c0-4cb0-be84-8e67e932643a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.958509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.959173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.959484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.959755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.960473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.960777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.962177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f051aec-15ea-41b0-85ed-00dac95f9171 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.974592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 285/567] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.975889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a942a5-36ee-4804-8a98-f21e30738a63 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.976171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a942a5-36ee-4804-8a98-f21e30738a63 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.976440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a942a5-36ee-4804-8a98-f21e30738a63 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.977654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 286/568] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:37.978337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a942a5-36ee-4804-8a98-f21e30738a63 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.995679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.996585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.996872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.997149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.997877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.998184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.999608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.011587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 283/569] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.012200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.032020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.084732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a942a5-36ee-4804-8a98-f21e30738a63 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.112666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3249a-626b-44cd-8fa2-a7665d5e4fc0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.117759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.118427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.118701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.118968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.119749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.120051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.121753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.129902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 287/570] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.130791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.147204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.147917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.148193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.148465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.149216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.149519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.150910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723f14-3b64-43e8-a229-ea9b956d07c5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.159056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 284/571] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.160305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.160590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.160863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.178178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:38.179369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:38.182384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.235704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371546c-c3af-4a11-9a09-cb18060e7c20 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.245961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.253312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 285/572] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:38.254179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.282963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.283802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.284084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.284361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.291437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.292966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:38.307416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:38.308513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 288/573] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:38.309698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.363407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c934-f4d9-4d5a-bc25-7781703fed90 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.399226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.400059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.400337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.400610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.407434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.408838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.411432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.411570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe94d2-7014-45af-9a59-5b0d70862be9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:38.423950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:38.424985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 286/574] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:38.426074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.447383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.448184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.448530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.448805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.458895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.460392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:38.477865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:38.478945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:38.480150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:38.480150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:38.480150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:38.480150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:38.480150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 289/575] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:38.480467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.507545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.532795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94aab2-e033-4fa4-ae59-d4f2ae19ac47 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.569403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.570215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.570499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.570775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.581372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.582845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.588228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014745c0-ad90-472a-b2ae-e94da4dcf34b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:38.599949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:38.601022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:38.602057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:38.602057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:38.602057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:38.602057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:38.602057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 287/576] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:38.602411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.626939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.627693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.627970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.628250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.639294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:38.647555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:38.648508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:38.649636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 290/577] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:38.650734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.661281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.714261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2ca73-525d-4b4b-9aef-cfdd48b7833e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.740907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.752050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.752683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.752969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.753245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.754047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.754425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.755898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.760716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135be2-4024-49c0-8105-3b71cdfa2806 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.770556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 288/578] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.771410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.802341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.802991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.803271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.803561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.804350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.804652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.806157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.818434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 291/579] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.819249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.876593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb6ca-84d6-488b-a414-49a005175cd7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.889826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.911528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.912205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.912484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.912777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.913498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.913805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.915190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.926746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 289/580] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.927363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a87b-94aa-41e1-b402-f73b02435f80 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.927588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.962117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.962786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.963068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.963366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.964176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.964522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.965889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.977524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 292/581] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.978627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.981719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.030304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496f74-0e1c-4ec9-a629-d288c5c1562b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.066496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.067397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.067677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.067947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.068721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.069026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.070415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.083297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 290/582] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.083518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082885a7-a193-44d9-83c0-6b2f372ee2b7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.083616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.113897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.114802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.115075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.115374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.116202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=8731b43dcbb644a9abde1b4b30f5911e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.116314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.116503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.118106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.123937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 293/583] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/role_assignments?user.id=8731b43dcbb644a9abde1b4b30f5911e&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.124716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.203382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.213434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38707e4e-6181-4918-9571-8ef5a1bcea6d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.247258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0788a4-ac86-4cbb-8926-1ec2fda183e1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.253906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.254904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.255188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.256115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/6c159e59080a41d2b1857c89c6e4c442/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.276087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=6c159e59080a41d2b1857c89c6e4c442, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.278360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.285824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.286708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.286993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.287267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.296259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 291/584] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:39 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/6c159e59080a41d2b1857c89c6e4c442/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:39.297527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.297815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.299297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:39.315593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.316627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:39.317580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:39.321735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 294/585] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.322785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.424232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.433508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cd254-2887-4c63-9cb6-afa35ec26823 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.457283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873125da-0e62-41f1-baa8-3736d69042a8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.482031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.482830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.483107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.483406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.493274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.493971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.494756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.507978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.508784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.509065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.509338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:39.513852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.514817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:39.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 292/586] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.516365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.521998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.523551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:39.541903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.542856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.543974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:39.543974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:39.543974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.543974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:39.543974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 295/587] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.544681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.679609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4c66-6ae7-4460-9b4a-c4b663dc18c1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.690766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b98c1-bf49-41f5-9f39-25fff53bc38a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.731418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.731418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.731418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.731418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.732157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.732157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.732157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.735327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.735327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.735327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.735327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.735955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.735955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.739327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.759334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 296/588] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.759334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.759807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 293/589] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.762805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.766636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.826742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.936532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4eda-9c13-4606-88cc-acddb8df7f03 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.964994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe36119-056d-4aac-9c47-9756c3a91fed None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.998456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.999628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.000140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.000620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.011657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.013402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.015330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.017334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.017612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.017877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.018609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.018908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.021254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:40.033933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.034884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.035819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:40.035819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:40.035819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.035819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:40.043402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 294/591] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.045132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.050941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 297/591] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.050941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.131685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.189154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.199094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6227-95ea-4cff-b7a9-004259539e93 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.227836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb220a-8dd9-4795-aaa1-aadb47a126d0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.248942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.249680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.249969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.250239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.250969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.251271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.252689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.273271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 298/592] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.273271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.274477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.275557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.276052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.276657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.288117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.289862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:40.309005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.309939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.310979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:40.310979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:40.310979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.310979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:40.313283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 295/593] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.314370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.379185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e982-f90a-4070-8d42-b41e27782dbd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.415983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.416784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.417092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.417361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.418846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d785cbb-35cf-4878-876b-cb49054fbb87 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.425403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.426862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.427939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:40.445080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.446129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:40.447072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:40.449614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 299/594] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.450599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.462588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.463618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.463879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.464148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.471700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.472591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.473354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:40.489794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.490819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.491803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:40.495622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 296/595] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.497171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.565749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671dd68-9a71-459e-bde4-a11352f53f86 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.603150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8450-b50d-403c-8fe6-f24790b8181c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.603607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.604641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.605134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.605682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.606596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.607086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.608691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.621506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 300/596] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.622607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.640314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.641323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.641455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.641705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.645082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.645082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.645082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.668812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 297/597] 10.222.0.82 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.669760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.698968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.719233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.746064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f430-2f57-4510-9bb6-1ee5b787a30d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.781513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2a23-a7a0-403e-82c6-276942d63924 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.784133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.785163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.785724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.786186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.787260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.787863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.789507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.804698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 301/598] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.805867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.832099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.832879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.833426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.833543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.841352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.842899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:40.858131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.859075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:40.860004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 298/599] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.861045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.916426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eefa4-5044-47f5-b611-6e4960b50627 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.951981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.955042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.956166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.956659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.957148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.961325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.970726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1750-830e-47a8-a8a2-5801d6f0d5e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.971132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.973181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:40.992180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.993158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.994063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:40.994063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:40.994063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.994063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:41.000787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 302/600] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.002032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.006311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.007338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.007770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.007943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.025305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=ab9ee3d95d2549159195ce82240f16ea, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.027015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.044816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 299/601] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:40 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:41.048229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.202133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca2be-4144-4442-9d75-e09e820b7d58 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.225706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81845222-5735-4fcf-b08d-7ff5ced8c7bb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.244581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.245779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.246271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.246755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.248158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.248797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.250533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.253039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.270435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 300/602] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.272695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.273370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.273659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.273923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.274718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.275022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.276781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.277581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.290223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 303/603] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.300326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.365311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.397589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e883661-50f1-45fc-aaa0-c878a923ff93 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.434039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9180-1f59-4979-9d33-a3bcb1f381ad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.442081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.443726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.444181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.445053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.455573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.457867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ef34370d-5b0a-4701-b5d6-b3eace64e4e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:41.478175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.479356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:41.480321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:41.482463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.482771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 301/604] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.483491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.483863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.484279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/4bacfdb698cf41dfb6be9a0e94daf371/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.485083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea741cb-f02c-4c0e-a8ee-548fd859f00c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.485529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea741cb-f02c-4c0e-a8ee-548fd859f00c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.485943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea741cb-f02c-4c0e-a8ee-548fd859f00c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.488120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 302/605] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:41.490049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea741cb-f02c-4c0e-a8ee-548fd859f00c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.514473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=4bacfdb698cf41dfb6be9a0e94daf371, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.516101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c82f09-9fc4-424b-848f-41dcb9d12166 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.532373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 304/606] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:41 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/4bacfdb698cf41dfb6be9a0e94daf371/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:41.533764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5537a-efb8-404f-8f76-441b38db0e12 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.534051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5537a-efb8-404f-8f76-441b38db0e12 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.534320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5537a-efb8-404f-8f76-441b38db0e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.558800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c8b5537a-efb8-404f-8f76-441b38db0e12 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:41.560097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c8b5537a-efb8-404f-8f76-441b38db0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:41.577299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.637216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea741cb-f02c-4c0e-a8ee-548fd859f00c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.637964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 305/607] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:41.639382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b7597-ef3e-4145-a6ff-8900c0a988a8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.639670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b7597-ef3e-4145-a6ff-8900c0a988a8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.639987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b7597-ef3e-4145-a6ff-8900c0a988a8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.641821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 306/608] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:41.647027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.647324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.647598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.666454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:41.668028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:41.697092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.706645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.707627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.708048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.708473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.709424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.709885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.711549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.724949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 303/609] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.726024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.753945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 307/610] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:41.755694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.843366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1abf6-2f08-48be-b581-3a887802d058 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.863971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.889025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.890130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.890411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.890683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.902250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ebefa-2b6c-418b-8bf5-793d4954abfb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.903970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:41.913687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.914673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:41.915532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:41.920357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 304/611] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.921392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.951673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.952539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.952815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.953083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/e626b6c267034377a800d89dd1a40bd7/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.969348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=e626b6c267034377a800d89dd1a40bd7, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.970802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.991593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 308/612] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:41 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/e626b6c267034377a800d89dd1a40bd7/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:41.992719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.015741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.059376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce611c0-7d01-4a25-b260-69f1a9c39f09 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.136764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.138003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.138650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.140991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.162464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:42.172929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.173944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:42.174768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:42.184688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 305/613] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:42.187046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd8c2-f8b6-4dfe-b44f-9738df350a10 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.190669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.239066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.241109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.241662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.242128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.243561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.244173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.245886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.247760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.278362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 309/614] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:42.282879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.372724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb561-8d79-4e3d-b8ea-b0e41e0c2005 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.408261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.409005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.409293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.409567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.410329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.410638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.412082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.421259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 306/615] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:42.428038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.451686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.521578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41765e5b-3071-4599-87ef-5a9555653f90 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.555283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9f8a-731c-41d7-8c52-1e30e74bcb7a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.556915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.593605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.594418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.594704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.594982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.606461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.608002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:42.626199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.627140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.628059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:42.628059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:42.628059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.628059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:42.628059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 307/616] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:42.628353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.628934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.629222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.629559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.634546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.676237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.677741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:42.733959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.735144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.736326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:42.736326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:42.736326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.736326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:42.748390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 310/617] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:42.757039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.765644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a0bd-95b8-4274-80d0-d86d2762c1fb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.802170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.803367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.803870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.804488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.805416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.805921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.807787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.820598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 308/618] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:42.830230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.855481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.936790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2dd3c-7cbd-46f1-9f42-b6bcf20e1e1f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.961993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0966-cc2b-4ee5-9444-cef76a05762e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.995423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.007257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.015708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.028691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.030038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.030558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.031155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.037508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 311/619] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.043479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.043479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.048165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:43.058655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:43.061169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:43.064072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 309/620] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:43.066132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.224966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.267336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f09b5-ceac-4285-87ad-1482f82874b9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.303947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.304641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.304924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.305296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.306298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:43.306656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.311410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.331335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 310/621] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.333545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.374119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09793f-e8dd-42bb-8ca4-1835177dff4e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.435981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4598d-60fe-4c83-94dc-1d97cee63091 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.463906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.472338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.473008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.473291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.473560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.508436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.509745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.510230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.510839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.524318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.526944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.545975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.547977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:43.586937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:43.588725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:43.590498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 312/622] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 542 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:43.600870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.660447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 311/623] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:11:43.667439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.721812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.747712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.791657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba9d2-c9e0-4780-8afb-ffe4b3d8c9d2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.795621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1736e5-8f78-4f41-aa91-f41049681fa3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.828168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.829078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.829366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.829815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.837547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.838161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.838941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.839224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.840390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:43.840642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.840759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.842074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.842181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d08aab17-e564-45ba-8711-c4771aa9d44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:43.860656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:43.861631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:43.862515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:43.862515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:43.862515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:43.862515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:43.862515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 312/625] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:43.867328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bccc-a08b-4454-80c1-14e22940c460 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.867328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bccc-a08b-4454-80c1-14e22940c460 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.867328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bccc-a08b-4454-80c1-14e22940c460 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.867829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 313/626] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.867829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.870283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 313/626] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:43.871204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bccc-a08b-4454-80c1-14e22940c460 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.957541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.984162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bccc-a08b-4454-80c1-14e22940c460 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.985511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.989604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cd622-0d24-4d51-b231-504c82db83f3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.023566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.024339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.024628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.024927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.025732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.026041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.027554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e66f1-aeaf-49fc-bcda-e289431a013b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.030585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.031447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.031732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.032007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.044881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.046217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 314/627] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.046449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.048010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.048298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.048843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:44.065878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.068025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 314/628] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.070190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.080081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:44.081820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:44.167575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 315/629] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:44.168875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.174499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82950-70b6-41af-ae40-70e000929068 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.210323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.211124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.211437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.211709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.218675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.220158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3e1d7938-da0f-4f9d-8ddc-cb54da958525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:44.235289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.236269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:44.237169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 315/630] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.238271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc69-61a8-48a5-9e9b-4ca935cce884 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.238271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc69-61a8-48a5-9e9b-4ca935cce884 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.238271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fbc69-61a8-48a5-9e9b-4ca935cce884 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.243629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 316/631] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:44.244383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fbc69-61a8-48a5-9e9b-4ca935cce884 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.251414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.262336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.289357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e08c7-44b6-40dc-927f-1602b540b26e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.331207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.333159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.333611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.333975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.335079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.335441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.337073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.353806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 316/632] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.354907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.364495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fbc69-61a8-48a5-9e9b-4ca935cce884 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.401814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.402733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.403079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.403447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.414673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-debd7251-849b-473f-8f92-10041daed7b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:44.423125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.424089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:44.424943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 317/633] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.425648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33910-262e-4260-8785-0260a777c63e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.426339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33910-262e-4260-8785-0260a777c63e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.426339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33910-262e-4260-8785-0260a777c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.448676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6fc33910-262e-4260-8785-0260a777c63e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:44.449904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6fc33910-262e-4260-8785-0260a777c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:44.474204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6fc8-7fec-48be-b7ad-1f9ef0519dd6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.502753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.512932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.513609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.513898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.514175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.514976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.515291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.516773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.521885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 318/634] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:44.522979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33910-262e-4260-8785-0260a777c63e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.526341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.529751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 317/635] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.530608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.649241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33910-262e-4260-8785-0260a777c63e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.656962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb0840-cf34-486b-9783-2ee9fbedf357 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.688090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.689164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.689582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.690016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.695433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.696200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.696589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.696871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.697851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.698253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.699894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.703527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.705278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.711001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 318/636] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.712536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:44.722905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.723959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:44.724871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 319/637] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.725374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.785130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.801607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.839218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add300-b7b7-464c-9319-5f2a8d71475d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.842942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44cc2-d83a-4dc7-b0c2-caadbde6f7e5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.874396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.875052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.875380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.875667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.876490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=6c159e59080a41d2b1857c89c6e4c442) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.876803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.876998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.877717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.877995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.878265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.878370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53755d03-8988-47ae-8b2e-71bf049c884a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.884272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 319/638] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/role_assignments?user.id=6c159e59080a41d2b1857c89c6e4c442&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.885729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b20b-a282-4b89-9822-c23593cc253c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.886212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b20b-a282-4b89-9822-c23593cc253c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.886736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b20b-a282-4b89-9822-c23593cc253c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.888290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 320/639] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:44.889226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b20b-a282-4b89-9822-c23593cc253c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.892839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:44.900874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.902020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:44.902864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:44.904240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 320/640] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.905425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.022380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb0296-950b-441c-ac40-a73d5e6825d5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.027067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b20b-a282-4b89-9822-c23593cc253c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.042705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.050916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.068456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.069699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.069699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.069873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.069962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.070353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.070451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.070644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.070748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.070908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.072161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4acbb-8287-46a9-af16-b215774a091e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.085113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.086013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 321/641] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.091545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.091691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.091691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.091691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.104006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:45.105267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:45.107937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.108870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.109792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:45.109792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:45.109792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.109792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:45.109792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 321/642] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.110081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.187341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 322/643] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:45.187341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.233731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5002-da24-47c7-addd-01b0e3aa523e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.276176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.276892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.277180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.277457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.278410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.278712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.280159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.289641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 322/644] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.290493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.297702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44833387-5916-4ce9-ac60-b4738944f14e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.312896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.323034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.341281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.342679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.342961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.343460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/8731b43dcbb644a9abde1b4b30f5911e/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.360558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=8731b43dcbb644a9abde1b4b30f5911e, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.362183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.378298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 323/645] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:45 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/8731b43dcbb644a9abde1b4b30f5911e/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:45.379151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.420943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c422f-c8f2-42c4-bb2c-eb0f10a46b29 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.463287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.464496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.464989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.465496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.466458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.466973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.468858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.482980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 323/646] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.484282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.498196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d873-480c-44a1-b88e-2db57589c2ac None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.537892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.538626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.538972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.539170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.552711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:45.560606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.561587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:45.562546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 324/647] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.563275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.586575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.591687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.604077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c972a-919b-42aa-9174-2b74b36a16f4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.646562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.646562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.646562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.646562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.656553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.658046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:45.677115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.678105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.678998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:45.678998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:45.678998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.678998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:45.678998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 324/648] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.679773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.689697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8b6f-76e5-4a6f-8ae5-07c9633ed5af None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.732549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.733452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.733798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.734157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.745381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.746867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:45.762935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.765868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 325/649] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.768110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.803915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d147-9e54-4ada-9a43-37bb3864659f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.839019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.839746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.840028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.840303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.841059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.841367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.842775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.851717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 325/650] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.852623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.855441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.858139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.879770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399345-7624-47d8-9236-3450671b03fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.916157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.916986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.917438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.917713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.918448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.918747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.920365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.936669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 326/651] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.936669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.958682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73334-33c5-4481-ba4e-1069810a7bad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.993253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.993959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.994218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.994491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.995401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.995712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.997182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.019410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 326/652] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.019410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.050506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181a06-ccc6-4d69-9a2f-e43921f6e1a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.083398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.094574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.095498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.095779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.096050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.107485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.108962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.110950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.126728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27f913-aef5-4195-a59f-8c4e78d82b04 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:46.130009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.130909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.131916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:46.131916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:46.131916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.131916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:46.131916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 327/653] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.132599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.162647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.163556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.163839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.164111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.172983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.174794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:46.195330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.196349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 327/654] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.197293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.251252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297ad0e-d749-4c1e-a5ee-90e10297d8c8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.289637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.290382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.290665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.290928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.310653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e1ff-5086-491a-91eb-810f6c2473c0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.332860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.348689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.349050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.349336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.349614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.350339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.350679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.352153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.358328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.367163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 328/655] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.367871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.368081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.369851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.474933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 328/656] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:46.475144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23de9-7072-452c-b8eb-a1e9ad885fbf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.476385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.513273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.513789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.514077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.514354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.515208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.515550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.517067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.538517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 329/657] 10.222.0.82 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.538517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.581704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.583735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.592154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156182-d924-4ea6-aaf7-1537b2bb0a41 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.633423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.634985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.635465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.636293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.646592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.648655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.656962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de242-7db8-4ca0-a0fa-38323e072071 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:46.670463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.671505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:46.672841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:46.674195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 329/658] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.674315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.703090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.704158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.704391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.704624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.717042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.718560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:46.738428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.739433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 330/659] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.740938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.795698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1743b-f8c3-40df-8ea3-af838de0799b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.834331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.835464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.835960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.836417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.841586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.850954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc567d1-361c-4c41-a21a-b1af937fb57c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.865041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.890528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.890896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.891182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.891492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.892338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.892666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.894111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.916360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.918181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 331/660] 10.222.0.82 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.918507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.919043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.032771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8be415-e97e-493e-a70e-7e8b0e85d827 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.038414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 330/661] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:47.039722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.071572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.072291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.072532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.072818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.073687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.074016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.075535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.092635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 332/662] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.092635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.100944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.103607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.155035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616bd37-8b15-4d35-82e1-4a7309945fc6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.205894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.206554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.206835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.206973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37a10-9519-4507-93d9-1da21fc22f8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.207453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.248196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.249312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.249453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.249679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.263172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.264841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a4836f15-55b2-46a1-be99-6410014cef5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:47.283564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.284864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.286168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:47.286168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:47.286168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.286168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:47.286168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 333/663] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:47.289508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7447d-0301-4a82-a27e-59804f7266a8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.290097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7447d-0301-4a82-a27e-59804f7266a8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.290373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7447d-0301-4a82-a27e-59804f7266a8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.295544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 334/664] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:47.295544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7447d-0301-4a82-a27e-59804f7266a8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.306735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.308380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.368197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.375521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.412975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7447d-0301-4a82-a27e-59804f7266a8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.431095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 331/665] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:47.431095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.455807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.456708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.457051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.457423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.465697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.467214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-55d88c7a-db03-4a0a-a85f-ba9b3e42bee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:47.482862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.483851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:47.484775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 335/666] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:47.485722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.485722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.485874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.504221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:47.505441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:47.546546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac449-b115-431c-a62d-bef14f88ba4a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.578108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 336/667] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:47.578976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.585554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.586224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.586506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.586894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.587654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.587960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.589622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.602684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 332/668] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.603564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.619779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.635889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.690833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7762-50ff-46f8-afc8-0f190016b736 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.718507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304e785-98e3-4219-9d63-62b8bd12c0fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.726992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.727868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.728142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.728403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.739385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.740872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.757051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.757772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.758059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.758332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.759175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e4850ac5-0f07-4345-91d7-1c03d313d8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:47.759282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.760313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.761319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:47.761319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:47.761319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.761319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:47.761539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.761608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 337/669] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:47.761682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.762143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735e24-5346-47e7-8b1a-2fcb1937fc9f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.762427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735e24-5346-47e7-8b1a-2fcb1937fc9f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.762703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735e24-5346-47e7-8b1a-2fcb1937fc9f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.764185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 338/670] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:47.764713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735e24-5346-47e7-8b1a-2fcb1937fc9f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.779133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 333/671] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.779133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.856167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.873255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735e24-5346-47e7-8b1a-2fcb1937fc9f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.874817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.882027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c5b19-63df-4143-8daa-7b69f5be4f18 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.908781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.909574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.909851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.910121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.916206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.917046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.917321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.917674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.920361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.922149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.924891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.926368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d683b528-813f-4c62-bb81-865d162f185e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:47.939518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.940603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.941551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:47.941551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:47.941551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.941551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:47.941881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.942672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:47.945209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:47.946149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 339/672] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:47.946249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 334/673] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:47.946249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.946397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.946397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.946397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.962754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:47.964144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:48.032607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 340/674] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:48.033453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.049101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bf5d-a97c-4dea-bdd5-2091985eebb0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.084245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.084899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.085231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.085446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.086172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.086471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.087886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.089615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.100876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 335/675] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.101677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.128795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.145823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd508-c138-48aa-b640-8d5d80dbbde5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.181584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.182252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.182593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.182869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.183744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.184059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.185550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.191675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 341/676] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.192404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.206062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40ac5-8187-4687-8ae5-49e7eef74f2d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.250519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.251264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.251542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.251821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.252593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.252902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.255849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.269314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 336/677] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.275031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.321327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794a6a6-4f34-49fc-aa0b-f95c9437cee3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.343474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.361393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.362375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.362843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.363363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.364579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.364897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.366368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.379272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 342/678] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.380550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.391883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.399845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a003d-95b5-40dc-8b59-584b8b756d07 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.443427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.443427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.443427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.443427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.455012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:48.462789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:48.464149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:48.465046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 337/679] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:48.465755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.499811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0752816-2e1f-4565-8014-67e394eef5e1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.536900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.537827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.538010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.538269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.547122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.548830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:48.564105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:48.565083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 343/680] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:48.570915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.581866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8355f81-2620-4e9c-a819-44e2aabc3e30 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.596895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.620033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.620970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.621425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.621559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.622239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.623750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.647613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 338/681] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:48 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:48.648367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.652601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.695537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad6df-6fd8-432b-a776-1376030a830a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.739782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.740678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.741063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.741456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.742584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=4bacfdb698cf41dfb6be9a0e94daf371) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.743010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.744887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.759060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 344/682] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/role_assignments?user.id=4bacfdb698cf41dfb6be9a0e94daf371&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.760204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.773221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726928-0a18-456e-9db3-6cd8e4b45c1c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.822936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.823724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.824002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.824271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.825059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.825360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.827267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.839218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 339/683] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:48.844189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.916877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.924815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83aa3-886b-4a10-b9c7-a1f13c9b2d2f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.968717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.978004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.979779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.980250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.980722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.981460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8877e2-0aae-4935-b6a4-1cf82831cf09 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.981711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.982027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.983814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.000003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 345/684] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:49.009784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.029990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.030796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.031071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.031414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.043299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.044799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:49.066825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:49.067810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:49.069038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:49.069038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:49.069038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:49.069038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:49.069038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 340/685] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:49.075343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.141329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16274-a61a-4186-ade4-dea650d80cc7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.179852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.191760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.193007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.193438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.194116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.195399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=e626b6c267034377a800d89dd1a40bd7) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:49.195864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.198121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.199077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c0d1-575c-422d-8684-b2e015aff974 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.207038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 346/686] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/role_assignments?user.id=e626b6c267034377a800d89dd1a40bd7&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:49.238044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.238996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.239462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.239880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.240804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:49.241256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.242829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.257885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 341/687] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:49.263659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.331069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.399747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ef3fc-3620-40f1-a7ce-7d8351384766 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.447808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.448664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.448942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.449261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.458683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.460203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:49.476111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:49.477120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:49.478070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 347/688] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:49.483787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.588196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239520-58d2-48f2-bd92-a2a8428c9c8a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.622779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.623485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.623763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.624034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.624879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:49.625179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.628218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.649397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 342/689] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:49.655096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.803093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6eb27-5ff9-44e3-9b46-2d6480e6bcce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.824997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.847915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.848531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.848842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.849122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.934242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.935759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.073814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 348/690] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:50.079320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.085923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.243492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ea2d-0bc5-4d53-a0f8-f1a5138d475c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.288958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.289762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.290036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.290301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.307206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.308730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:50.330234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:50.331185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:50.332124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:50.332124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:50.332124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:50.332124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:50.332124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 343/691] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:50.337343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.376907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.484467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655370df-d192-4a39-bf76-5f10312e76d0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.518535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.519138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.519458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.523332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.523332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:50.523332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.523332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.539463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 349/692] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:50.540919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.601497 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.652203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d640a-8352-457c-8b2d-40e48a7af22f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.688245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.689054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.689335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.689610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.696787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.698325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c5161407-6eec-4dfe-ab2c-028e99ba042f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:50.721221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:50.722210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:50.723106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 344/693] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:50.728932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.767464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc85ec-babe-432d-9d43-27b014f71a4e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.767790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc85ec-babe-432d-9d43-27b014f71a4e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.771068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc85ec-babe-432d-9d43-27b014f71a4e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.771068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 345/694] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:50.774293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.774580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.774855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.807492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:50.808702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:50.849176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.874446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0028-e265-48c6-94f3-9492045bcdaf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.912735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.913415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.913696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.913965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.914754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:50.915060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.916760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.935574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 350/695] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:50.938863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.044802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 346/696] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:51.047085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427cd4-d820-47b9-bcd7-c67d990ec9b8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.082453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.083128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.083441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.083716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.084386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.084829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=8731b43dcbb644a9abde1b4b30f5911e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:51.084829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.086279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.095654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.097397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 351/697] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/role_assignments?user.id=8731b43dcbb644a9abde1b4b30f5911e&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:51.174635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.248957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d732-9e8f-47d0-a84d-d71018d19a07 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.293896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.295861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.297026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.297813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.312463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d86f2252-9042-4c88-8e3a-00209255eff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:51.320677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:51.321645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:51.322492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:51.325359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 347/698] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:51.330878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.440540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a2a70-3216-4187-a284-f1d42de0fac4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.478352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.479483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.479999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.480471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.481426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:51.481932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.483545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.486766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3976-c166-49a1-9a8e-46e7f560613e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.487052 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3976-c166-49a1-9a8e-46e7f560613e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.487584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3976-c166-49a1-9a8e-46e7f560613e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.489049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 348/699] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:51.494379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0c32-1524-4770-a42e-bd9c1c1566a0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.494664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0c32-1524-4770-a42e-bd9c1c1566a0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.495021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0c32-1524-4770-a42e-bd9c1c1566a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.496335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 352/700] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:51.501777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.518015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-afaf0c32-1524-4770-a42e-bd9c1c1566a0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:51.519210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-afaf0c32-1524-4770-a42e-bd9c1c1566a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:51.568796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.611580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 349/701] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:51.612932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bf59-3b9c-424d-812d-57236c73b341 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.613210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bf59-3b9c-424d-812d-57236c73b341 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.613478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bf59-3b9c-424d-812d-57236c73b341 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.614856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 350/702] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:51.623339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25292dd-c1f6-424c-b1d7-c3a80db930ff None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.623501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.623501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.623501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.638346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:51.640006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:51.672237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.678821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.679894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.680355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.680774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.694501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.696191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:51.713654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:51.714834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:51.716008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:51.716008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:51.716008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:51.716008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:51.717464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 353/703] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:51.718356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.719380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 351/704] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:51.723953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.850749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a54f-d47e-447f-b07d-dda1e9185186 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.853103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96ccf3-fe4a-420f-993c-189a84c85b80 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.868379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.896596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.897723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.898153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.898570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.900322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.901143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.901513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.901918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.902737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:51.903130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.904665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.913210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:51.917032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 352/705] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:51.918726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6a0708f3-d328-43d3-b03b-de78a7263417 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:51.921869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:51.923001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:51.923950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 354/706] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:51.924694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479e51-e87f-4712-8c5a-c69268f7ac72 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.925055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479e51-e87f-4712-8c5a-c69268f7ac72 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.925212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479e51-e87f-4712-8c5a-c69268f7ac72 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.927135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 355/707] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:51.927586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78479e51-e87f-4712-8c5a-c69268f7ac72 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.955191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.039781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5249a63-e633-43a8-9178-60783f258a25 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.043843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78479e51-e87f-4712-8c5a-c69268f7ac72 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.079007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.079865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.080140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.080410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.080737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.081064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.081542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.081825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.082103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.082441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.091176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.092687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.096732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:52.099832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 353/708] 10.222.0.82 () {56 vars in 1129 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.100956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-444353ef-ad5d-4d3d-955d-245b7b1aa533 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:52.107757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.109906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:52.112118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:52.114161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 356/709] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.114560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.114842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.115112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.132204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:52.133383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:52.162531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.199453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.212646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 357/710] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:52.213119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a05938-da5c-4c85-96fe-b0e1a89b978f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.213941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.254313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.255253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.255634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.256014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.257218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.257626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.259882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.275016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 354/711] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.275016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.348649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f717e-5555-4ca0-8dac-5274e3989b69 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.378518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcedcd-7016-4644-be7a-995011d28bc9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.386066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.386788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.387066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.387336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.388050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.388571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.389954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.399327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 358/712] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.400161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.414982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.415788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.415964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.416237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.417228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.417535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.418986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.430114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.438164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 355/713] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.438800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.449605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.517639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6dae5-a142-4e6a-8e69-7b55bd509400 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.543524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b11f-9774-451c-8277-c405a2d773d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.556686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.557536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.557820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.558096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.558797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.560217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.575031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.576484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:52.578106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 359/714] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.578955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.589605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.590660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.590936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.591202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.602156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.603692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:52.623375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.624399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.625343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:52.625343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:52.625343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:52.625343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:52.625343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 356/715] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.625629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.689573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.698654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.699939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b241d-202f-4eef-b42f-ae8a88aa66fd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.736363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.737033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.737313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.737582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.738288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.738595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.740020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.743869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44dc55-8637-4d33-b69e-90e4a0db29a7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.755522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 360/716] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.756546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.785544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.786223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.786504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.786778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.866811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.868426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.893149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b7d5b-37fe-457c-9021-a370e131008e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.936199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.937505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.937656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.937888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.938165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.938880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.939252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.940691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.952169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 361/717] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.952169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.978240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.004311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 357/718] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:53.005463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.082819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5868-38b4-49db-90ae-9aef8fdeed11 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.124507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.125286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.125624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.125907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.126644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.126953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.128121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3826-be8f-4627-99ca-808bb54756f9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.128578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.147393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 362/719] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.148318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.169771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.170449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.170731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.171075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.172189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] RBAC: Adding query filter params (type=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.172496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.173896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.180476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 358/720] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.181410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.217524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.291007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.346492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b405c-5d3f-484f-b4b1-e8d62c1c5bec None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.350954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8571f-aaa2-4707-b696-e68ece306e8b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.391278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.392398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.392828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.393198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.407161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.408863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.410889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.411889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.412351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.412624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.426133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.427738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:53.429714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:53.430854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:53.432040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:53.433892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 359/721] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:53.439939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:53.474814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:53.475903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:53.476964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:53.476964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:53.476964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:53.476964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:53.479688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 363/722] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:53.487081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.564969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.583898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6537-24ae-45b2-8035-83195c418c32 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.617432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2510-983f-4788-bba8-eceaabdb9f68 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.621286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.622145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.622571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.622983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.624201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.624654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.626382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f171d-feac-41aa-92fc-4ca1c0bfc73d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.647330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 360/723] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.648341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.650448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3cec4-c634-4bca-8ae5-3543f05927e4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.650865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3cec4-c634-4bca-8ae5-3543f05927e4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.651444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3cec4-c634-4bca-8ae5-3543f05927e4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.653319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 361/724] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:53.654063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3cec4-c634-4bca-8ae5-3543f05927e4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.662704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.663507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.663788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.664068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.664796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.665099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.666578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454c3c3-1e20-4b36-860b-89fddb0b6324 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.679722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 364/725] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:53.681311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.681603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.681908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.699268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:53.700566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:53.759860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3cec4-c634-4bca-8ae5-3543f05927e4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.770452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 365/726] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:53.771343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.796258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.797354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.797630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.797899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.811995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.872547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.874156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.897406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a816ed-529e-4cf3-8dfd-f6bdaf9a5bd9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.923692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.934281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.935102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.935412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.935683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.943562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.945145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:53.960000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:53.961126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:53.962156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 366/727] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:53.962747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.986498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 362/728] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:53.987554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.033922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.072188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d82c-bbc9-4dbf-a9fe-316a5641400a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.093365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d06-effa-4b4d-a290-0e3a3d4f544a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.107887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.108828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.109201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.109587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.120816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:54.128117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.128780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.129061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.129331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:54.129781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:54.130740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:54.131633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:54.132274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.132274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.132407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 367/729] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:54.132407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.136918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.149942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 363/730] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.150904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.183247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.244269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2f301-ba67-4cd5-8006-33f6c3e03e43 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.254620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4827e4-7680-4387-bfb5-74bb85767276 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.256261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.281797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.282857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.283329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.283740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.290281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.290962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.291579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.291791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.292548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.292935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.294390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.296386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.298366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.308350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 364/731] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.309408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:54.316427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:54.317484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:54.318544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:54.318544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:54.318544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:54.318544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:54.320400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 368/732] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:54.321327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.417494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.418596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3282-1b12-481f-a217-0206ec6aa53c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.426474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449e6c-315f-4980-868e-3be42809e2ff None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.456199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.456911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.457132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.457569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.458413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.458721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.460201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.464857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.465857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.466290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.466695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.466868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 365/733] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.467847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.479756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.481597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:54.500154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:54.501217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:54.502294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:54.502294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:54.502294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:54.502294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:54.504184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 369/734] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:54.511738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.514122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.586605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89d56-df12-40e9-82cc-43ec8b751379 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.638072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.638752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.639030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.639299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.640057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.640355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.641769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.667572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 366/735] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.673865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.704817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efeab8-3311-4d25-86f6-3db1f33c21d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.787080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.787779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.788058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.788322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.789051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.789353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.791560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.811716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.813830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 370/736] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.821248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.829538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30744f-bfb3-4fd3-a2dd-262c0db5f02b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.836018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.875644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.876374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.876653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.876922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.888260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.889730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:54.916019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:54.917057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:54.917984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:54.924266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 367/737] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:54.929348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.020533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309acc-f481-471c-a34f-706d709b3bc6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.064859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.065715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.066000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.066265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.076490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.078108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.093732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b9c03-cfaf-4a70-9d59-b82c13dc102a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d4777d50-ba2c-4114-81cc-964d5ff98e92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:55.094822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:55.095726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:55.096660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 371/738] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:55.098079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087c92-6b86-43ae-90cc-c4a8cf693ae8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.098510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087c92-6b86-43ae-90cc-c4a8cf693ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.098925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087c92-6b86-43ae-90cc-c4a8cf693ae8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.100899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 372/739] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:55.101847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2087c92-6b86-43ae-90cc-c4a8cf693ae8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.130548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.131130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.131459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.131739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.132633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:55.132950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.134532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2e46-d1a7-4a3e-b1a3-26f101518a1d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.148403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 368/740] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:55.149720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.150106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.150384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.168424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:55.169743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:55.172364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.177106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.216155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2087c92-6b86-43ae-90cc-c4a8cf693ae8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.249239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 369/741] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:55.250126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.254367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.255194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.255559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.255897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.256894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:55.257260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.259038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.280815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 373/742] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:55.285812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.365276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a7a89-efdc-4f7a-aa92-cceff3a2a317 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.411392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec7978-52b6-4e2d-97a0-eeb6084a7d7e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.411722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.412384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.412909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.413185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.414900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=3df3d72eea444df9b8a8b945c3eb37b2) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:55.415212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.416717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.424172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 370/743] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/role_assignments?user.id=3df3d72eea444df9b8a8b945c3eb37b2&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:55.425078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.428010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.443969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.457786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.458603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.458884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.459152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.459929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.462067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d888c-de23-4215-a44a-478f39751ea9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.499338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 374/744] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:55.608595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a54-f924-4d18-abfe-1d4a4fa3bdc6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.608926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a54-f924-4d18-abfe-1d4a4fa3bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.609149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a54-f924-4d18-abfe-1d4a4fa3bdc6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.610885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 375/745] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:55.615702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e1b7-81c7-4b86-9cf6-3095cacd50e8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.617261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.617761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.618359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.653649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:55.654881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:55.721365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.722042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.722320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.722590 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.769469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 376/746] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:55.795025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.803691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.807764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.809375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.935425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 371/747] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:55.936913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.938027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3807-c88e-4dbd-bd99-61f801eb822f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.957832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.988157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.988757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.989038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.989309 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.990046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.999549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.021262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 377/748] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:56.078404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.083450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327bb7-7e83-4ce2-a513-14aad3eb5146 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.140826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.141662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.141953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.142230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.155962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.157508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:56.187201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:56.188197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:56.189093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:56.189093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:56.189093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:56.189093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:56.192967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 372/749] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:56.194449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.321716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fced6e9-7898-413d-9f51-7bd5ed0ed794 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.355773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.356459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.356741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.357018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.357749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.358058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.359482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.372405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 378/750] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:56.378173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.489266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639dc3-032f-449f-8786-33930b686c17 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.525020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.525840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.526172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.526446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.534079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.535578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:56.551100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:56.552071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:56.552948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 373/751] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:56.560426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.604390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.701392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab8712-c2e6-49e0-bb44-46ff0a7635ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.767198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.767902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.768193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.768460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.769247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.769562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.771025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda37b1-53a3-448e-a65e-8df833a214bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.787704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 379/752] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:56.796787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.806318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.955203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e17e38-b496-4d54-80cf-5e08b4f42655 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.992595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.992963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3fd15-3da3-4499-a3d6-b4061f64eb1c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.993260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3fd15-3da3-4499-a3d6-b4061f64eb1c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.993361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.993543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3fd15-3da3-4499-a3d6-b4061f64eb1c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.993641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.993866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.994698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=8731b43dcbb644a9abde1b4b30f5911e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.995073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.996555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.998562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 380/753] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:57.003623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.003919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.004199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.006463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 374/754] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/role_assignments?user.id=8731b43dcbb644a9abde1b4b30f5911e&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.040604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:57.041945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:57.147905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 381/755] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:57.192989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.294198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.329473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7404c-abb3-4780-80e7-17d576affdf6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.370425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.371428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.371715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.372047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.388609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:57.396347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:57.397297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:57.398766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 375/756] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:57.403522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.454921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.558050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e52b6-1f53-4b9a-92b7-9691e3aea00c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.592951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.594030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.594513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.594984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.595970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:57.596476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.598177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.607897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 382/757] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.615376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.761983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512115b5-13d5-4664-b520-bd53be81b36a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.807145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.814787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.815569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.815849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.816117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.827722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.829203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-bf6ce89d-6e3a-4bb5-b2f9-eae7aa9b4428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:57.846794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:57.847752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:57.849087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:57.849087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:57.849087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:57.849087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:57.849087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 376/758] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:57.854159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.953891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c42b8-e7c7-4f09-a907-6a9fa0b45ce9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.954226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c42b8-e7c7-4f09-a907-6a9fa0b45ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.954437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c42b8-e7c7-4f09-a907-6a9fa0b45ce9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.956105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 377/759] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:57.969506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.970159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.970439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.970713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.001479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1f9b-b4d8-44f6-9780-464846aee8bf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.003925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:58.010576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:58.065638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.067112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.067657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.068156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.069095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.070021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.072172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.098895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 383/760] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.104260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.111507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 378/761] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:58.183498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.261187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c65c6-2988-4547-94d7-9b9bd592d80b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.332042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.332767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.333045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.333315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.351669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.353171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.371464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa932e7-dedc-4e63-ac14-959de0bed5d6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-677a7ac7-da25-4590-929c-3a669c530026 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:58.376976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.377935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:58.378905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 384/762] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:58.380025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544736-8cc9-4794-9ef3-e96f563b9710 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.380025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544736-8cc9-4794-9ef3-e96f563b9710 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.380274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544736-8cc9-4794-9ef3-e96f563b9710 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.381836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 385/763] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:58.387165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.387657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.388092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.392637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.401079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.409104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:58.410510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:58.415952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.416823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.417080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.417346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.428778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:58.436782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.437990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 379/764] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:58.439093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.491181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 386/765] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:58.500622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.561327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962004-089f-403d-9ae8-d85c7633c95a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.606323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.606908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.607185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.607507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.608362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.608874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.610442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.626519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7a2f4-e7e5-4259-babb-1f69824de700 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.643471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 380/766] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.644750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.676741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.678072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.678452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.678824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.679918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.680286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.682258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.685275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.689277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.699129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 387/767] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.699129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.769152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849846f8-8ffd-479d-8b91-0dd51edf5c8f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.806182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.807345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.807792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.808255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.808932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5f6b-0c32-42b5-b780-c6b8d6f5a209 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.809265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.810807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.823515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:58.825581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:58.828138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 381/768] 10.222.0.82 () {56 vars in 1129 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:58.829058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.854345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.855162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.855486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.855758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.867462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.868871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dd5e5c92-c1c2-49ef-8545-71f3f1d39ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:58.886408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.887395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 388/769] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bdf83-cdb7-47f9-bd81-8618668eee9e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bdf83-cdb7-47f9-bd81-8618668eee9e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.893426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bdf83-cdb7-47f9-bd81-8618668eee9e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.895465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 389/770] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:58.896287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bdf83-cdb7-47f9-bd81-8618668eee9e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.943840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.951703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64613ecf-80e1-4a49-bf22-e5e83d10b787 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.962165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.987944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.988758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.989035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.989304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.002197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.003658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.021009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bdf83-cdb7-47f9-bd81-8618668eee9e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:59.022266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.023183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.024146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:59.024146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:59.024146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:59.024146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:59.024146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 382/771] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.024425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.065105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.065782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.066060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.066327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.067030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.067358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.068740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a98725-7995-4a1d-86d9-a7cd7ee15ce9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.079658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 390/772] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.081476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.081711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.083530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.100473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:59.101698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:59.133621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f815-95cc-42be-9212-c68e3f1db4fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.171325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.172349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.172628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.172903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.173633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.173938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.175370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.178757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 391/773] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:59.179829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.197564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 383/774] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.197564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.207609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.243031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.302389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c30df-3be2-4a3b-a2bf-a83c02a44077 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.308310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40844ad7-9d5d-4a19-bca5-26f6690424be None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.339163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.339876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.340159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.340440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.341167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.341475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.342896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.353626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.354603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.355027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.355408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 392/775] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.355617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.356242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.356718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.357037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.358428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.366042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 384/776] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.367000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.447298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.470463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3ed15-d828-4639-8cb5-6e137a60aa5b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.472798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.477616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a2ac-d498-49e2-8450-b8a3f2b9ab70 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.505711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.506515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.506796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.507072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.512018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.512818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.513103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.513378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] PATH_INFO: `/v3/services/network` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.513956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.514048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.515431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.515537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.527236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.528249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:59.529094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 385/777] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.529969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:59.530044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.530823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 393/778] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.533109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.637017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0717bd-8b13-4bb3-9441-590cf1f5a630 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.640829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83f045-94bb-4ead-bde5-07f2f05b1377 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.687698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.688541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.688822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.689079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.690542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.691516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.691641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.692046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.692446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.693875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] RBAC: Adding query filter params (interface=public, service_id=dd27acf6ee194941a2012da52f87fd40, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.694339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.696680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eba7-bec5-4df7-8e14-8acbe6689c13 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.698631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.700607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.709086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 394/779] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/endpoints?service_id=dd27acf6ee194941a2012da52f87fd40&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.710995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63526-caa8-40f2-be45-683391e5dd14 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.711478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63526-caa8-40f2-be45-683391e5dd14 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.711916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63526-caa8-40f2-be45-683391e5dd14 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.714105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 395/780] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:59.715234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63526-caa8-40f2-be45-683391e5dd14 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:59.716660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.718553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 386/781] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.720753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.750703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.834223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63526-caa8-40f2-be45-683391e5dd14 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.839699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6315-eb1f-4977-9802-41e10a5a6f46 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.872351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.873079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.873299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.873572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.874291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.874603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.876056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.876221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.876730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.877012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.877284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.878081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.878389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.879896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b37936-1142-43a9-b09d-a2cbb564d247 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.881169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 396/782] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.881986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.893684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 387/783] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.895711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.895711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.895711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.913941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:59.915174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:59.976930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.988009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.996045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 388/784] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:59.996892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.002785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced063e-d8db-4562-9af7-d6f224013365 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.041854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.042590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.042875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.043151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.043867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.045271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.051155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 397/785] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.051988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.127997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d34dbe-001f-47a7-9c1d-9f550e06d8c5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.167437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.168134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.168411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.168677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.169532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.169838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.170071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72d07-f815-4448-895b-0537819fc598 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.171802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.195326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 389/786] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.196972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.212394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.212988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.213270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.213543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.214271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.214591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.216113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.222426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 398/787] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.223943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.255626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.259275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.328356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4cbe-18f1-409e-a995-8620b1d6d7d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.350161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a204-ca01-4e80-b3c0-909e9763d8d5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.364518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.365423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.365705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.365974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.368037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=ab9ee3d95d2549159195ce82240f16ea, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.369523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.385451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 390/788] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:00 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:00.386092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.398645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.399903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.400187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.400462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.414122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:00.423672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:00.424771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:00.425723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:00.428382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 399/789] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:00.429524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.521299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a7-fa9f-4103-9d0d-e5e96b8b80b9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.523249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.545295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.568360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.569490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.569931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.570197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.573987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198641-ece1-4f84-9b17-1570c1fa1d61 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.582593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.584121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:00.606066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:00.607034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:00.608204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:00.608204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:00.608204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:00.608204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:00.608502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 391/790] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:00.609372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.623142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.624357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.624875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.625329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.627128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] RBAC: Adding query filter params (interface=public, service_id=9babe1f60b984f4bae9eb6ff45b58be3, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.627660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.629962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.638842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 400/791] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/endpoints?service_id=9babe1f60b984f4bae9eb6ff45b58be3&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.640602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.742084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded4e5-2508-42c8-9bc8-11152fd47d05 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.768210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1518-190c-497b-bff3-db68170b28e6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.785708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.786304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.786715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.787193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.787991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.788294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.790421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.807354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 392/792] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.807354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.814078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.815058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.815585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.816083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.817066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.817576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.819169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.825796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.836622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 401/793] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.838067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.844100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.950085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854566-7b60-41c7-9d20-4875e28cacc7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.966719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413529-9bc4-4723-aed0-b347d76fde0a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.988853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.989525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.989808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.990081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.990771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.992201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.997919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 393/794] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.998732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.013110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.013976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.014195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.014471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.026560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.028132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:01.047853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:01.048829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:01.049731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:01.049731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:01.049731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:01.049731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:01.049731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 402/795] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:01.055242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.108943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.132788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ffe1-7db7-4640-b774-05d77a4b068a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.134413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.175281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.175281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.175281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.175281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.181919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.184231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:01.202659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:01.203679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:01.204608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 394/796] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:01.210273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.221166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e2a0-cef0-402c-9042-a8f6d4b4a1ba None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.259737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.260475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.260761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.261039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.261779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:01.262128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.263811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.278138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 403/797] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:01.284327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.333571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23337-46c8-46da-9daa-5e2f98db52b4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.374030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.375152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.375675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.376176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.377311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:01.377952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.379686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.390003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.394233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a61-b13d-478d-b188-d816264304ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.395644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 395/798] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:01.401866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.412755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.432116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.432962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.433244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.433517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.442261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.443923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:01.459714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:01.460734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:01.461704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 404/799] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:01.467154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.518380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3ccb-4375-4f57-8e83-555b91bdff31 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.555885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.557720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.558235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.558808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/3df3d72eea444df9b8a8b945c3eb37b2/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.576007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=3df3d72eea444df9b8a8b945c3eb37b2, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.576331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd021c2-fc7c-41be-8c36-c0444d633149 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.578110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.601266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 396/800] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:01 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/3df3d72eea444df9b8a8b945c3eb37b2/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:01.614286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.615035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.615348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.615660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.616522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:01.616843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.618411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.641106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 405/801] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:01.648009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.707047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.781050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bc70-7ff2-44ba-876c-a229e92fb0e0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.824240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.825061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.825342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.825616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.836677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.838284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:01.857754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:01.858720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:01.859661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:01.859661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:01.859661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:01.859661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:01.859661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 397/802] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:01.865042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.903931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.973787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bed8a-50ec-41ac-bcd4-435763abf52a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.009381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.010062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.010428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.010713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.011478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.011787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.013179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.025523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 406/803] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:02.031177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.161507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb2278-db26-4f29-bf52-a0e3ee4dc953 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.162959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.213494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.214310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.214596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.214870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.227902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.229936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:02.247154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:02.248158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:02.249077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:02.252911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 398/804] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:02.254277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.416722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.427611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ddca-2bc0-4003-8f47-85a57ea44f0b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.472856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.473532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.473814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.474088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.474880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.475187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.476677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c194d-ce41-4388-9100-9002378cb683 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.501095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 407/805] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:02.506643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.577827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4970-fd52-440a-88cb-58bd710d5235 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.578123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4970-fd52-440a-88cb-58bd710d5235 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.578372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4970-fd52-440a-88cb-58bd710d5235 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.579812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 408/806] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:02.588238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b744-bc05-4bed-989d-69b4d4ad5ad6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.588599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b744-bc05-4bed-989d-69b4d4ad5ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.588880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b744-bc05-4bed-989d-69b4d4ad5ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.616766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6226b744-bc05-4bed-989d-69b4d4ad5ad6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:02.618391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6226b744-bc05-4bed-989d-69b4d4ad5ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:02.661889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf9f-a314-433a-b0d4-973a924415e3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.713992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.715941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.716461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.716928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/8731b43dcbb644a9abde1b4b30f5911e/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.719681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=8731b43dcbb644a9abde1b4b30f5911e, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.721401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.742271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 399/807] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:02 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/8731b43dcbb644a9abde1b4b30f5911e/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:02.760145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 409/808] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:02.799621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.800703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263694-abe7-425b-9780-9353c1a77652 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.801194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263694-abe7-425b-9780-9353c1a77652 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.801688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263694-abe7-425b-9780-9353c1a77652 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.803719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 410/809] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:02.826285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.826484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.826714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.842381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.846620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:02.847879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:02.955404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 411/810] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:02.981038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2104-fa2f-495b-aabe-376751d16ba6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.985780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.002807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.024947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.025783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.026103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.026371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.027160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.028602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.043788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:03.044816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:03.045658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 400/811] 10.222.0.82 () {56 vars in 1129 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.053883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.156017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc5834-0437-494c-9b70-b9dc552dd5e1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.191985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.209425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc2f78-60db-4272-9756-b6f4d93f216d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.214577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.215707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.217695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.218186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.242228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:03.250767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:03.251776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:03.252631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:03.261173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 412/812] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.267752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.279220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.280299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.280768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.281248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.282152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.282648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.284280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.289846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 401/813] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.300407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.362831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.390538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5fca-d588-42b4-b84c-f0a91c15c97b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.426185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.426860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.427139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.427440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.428206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.428508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.428985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9485e4-1374-42c2-be17-b7dd81011159 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.429888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.438949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 413/814] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.444219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.466035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.467082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.469313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.470599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.472352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.473034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.475812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.481780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 402/815] 10.222.0.82 () {56 vars in 1124 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.492370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.517632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.570139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6556-df79-4994-b172-8f440e665487 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.617581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.618404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.618690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.618956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.625059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.643182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.645971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.664865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796864b-9b0d-44d6-94f0-42f39fc4faa5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:03.680316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:03.681276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:03.682651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:03.682651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:03.682651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:03.682651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:03.682651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 414/816] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.687527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.739404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.741215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.741499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.741772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.742589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.743978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7abf0-2ee2-45c7-852d-b4d49f69c907 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.788245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 403/817] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:03.799378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c334-6385-4302-9fb4-f302618d9e3f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.799701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c334-6385-4302-9fb4-f302618d9e3f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.799935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c334-6385-4302-9fb4-f302618d9e3f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.801391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 404/818] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:03.807525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.807868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.808078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.830695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:03.833144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:03.888896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dd6e-5f41-4613-abb3-3501bc6f5742 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.964040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.964821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.965103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.965375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.966114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.966419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.968196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.980526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.988057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 415/819] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.991243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 405/820] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:03.993342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.015827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.047668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.111644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c67498-7259-49af-8b20-8f6e7fd44a29 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.129138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787673e-cd02-4b32-8ca1-4fa4ccc9ff96 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.149793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.150614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.150961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.151355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.159639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.161444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.165866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.166717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.166995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.167262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.167948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.169336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:04.178702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:04.180824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:04.183027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 416/821] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:04.183814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:04.188831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:12:04.190812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:04.192344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.192446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 406/822] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:04.198475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.315769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.366145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02426-3436-4e39-85fd-6525768e6196 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.371712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.385393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927787c-e21a-446e-9878-c4346972cac0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.421724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.423015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.423547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.424107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.424610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.425248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:04.425651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.425791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.426216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.426668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.427492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e88e3-979c-482c-b854-0d77ee8955e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.427709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:04.428150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.429663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516282b-32a0-46b9-a137-dfbf714822e8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.435159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 407/823] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:04.436798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434215-304f-4d3f-8148-16579e5a173a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.437254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434215-304f-4d3f-8148-16579e5a173a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.437689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434215-304f-4d3f-8148-16579e5a173a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.439230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 408/824] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:04.442836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434215-304f-4d3f-8148-16579e5a173a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.463400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 417/825] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:04.463400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.463400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.463400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.482264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:04.484219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:04.579413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 418/826] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:04.579413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.589326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434215-304f-4d3f-8148-16579e5a173a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.622722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.632275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.632903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.633185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.633453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.634159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] RBAC: Adding query filter params (type=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:04.634456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.635952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.646379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 409/827] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:04.647348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.688352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.699477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32ece-ffb8-4b18-ae2d-8501bbf09795 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.738345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.739767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.740257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.740739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.766161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134779af-beed-4eb4-9f10-d823a17ad20a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.812303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.813503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.813987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.815020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.830480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:04.831852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.833343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:04.840644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:04.841645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:12:04.842493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:04.850273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 410/828] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:04.850273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.910810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.963560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.964886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da561e-f865-4c74-a339-08dcf403be5c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.982488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 419/829] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:04.984005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.007284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.007993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.008268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.008535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.009312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.010707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.033684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 411/830] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:05.034617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.131028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddd171-60b0-4810-ae97-b144a93c6b8c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.176905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf721d-f7c7-4db4-9a14-ce71dbf29f71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.180935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.182493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.183559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.184200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.184746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.185740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:05.186251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.189583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ffd6b-9640-4d35-a433-1a10a52bcec8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.202482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 420/831] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:05.204435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3ac6-ffd6-4df9-b6ff-42057ff4c537 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.205201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3ac6-ffd6-4df9-b6ff-42057ff4c537 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.205696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3ac6-ffd6-4df9-b6ff-42057ff4c537 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.207777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 421/832] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:05.212184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3ac6-ffd6-4df9-b6ff-42057ff4c537 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.232572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.233382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.233661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.233924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.248643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.251263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fb43d73c-cc29-4d48-ba79-2b0248706a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:05.272050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:05.273014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:05.274080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:05.274080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:05.274080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:05.274080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:05.274080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 412/833] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:05.279964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.280821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.281101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.284347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.304602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:05.305799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:05.349210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3ac6-ffd6-4df9-b6ff-42057ff4c537 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.375123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 413/834] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:05.376385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.393205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341075-8817-4542-8592-6574b510468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.393955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341075-8817-4542-8592-6574b510468d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.394240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341075-8817-4542-8592-6574b510468d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.394512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341075-8817-4542-8592-6574b510468d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.407372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341075-8817-4542-8592-6574b510468d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.408863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341075-8817-4542-8592-6574b510468d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e3341075-8817-4542-8592-6574b510468d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:05.428906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:05.429854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:05.430775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:05.430775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:05.430775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:05.430775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:05.430775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 422/835] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:05.431067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341075-8817-4542-8592-6574b510468d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.474893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.490639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf0a5-6a98-430a-a740-6ad995ebde24 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.529625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.530300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.530571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.530848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.531609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:05.531916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.533540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.536381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341075-8817-4542-8592-6574b510468d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.538092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.546690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 414/836] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:05.551769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.575458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.576390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.576583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.576824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.587735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:05.595706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:05.596687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:05.597529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:05.599608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 423/837] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:05.601009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.660190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cef6-50ce-4bcc-863f-dc5bea1cd5e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.696448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.697090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.697367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.697673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.698392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:05.698691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.700103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.718772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 415/838] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:05.718772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.726903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551f464-7db3-4399-8ceb-3055a36346ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.728006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.764616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.765727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.766131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.766541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.776650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.778189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:05.792259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:05.793198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:05.794082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 424/839] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:05.794575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.825191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.831005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a853fa-1a27-46bd-b0d3-b004f787feca None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.866958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.867650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.867927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.868193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.868934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:05.869231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.870739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.883723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 416/840] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:05.883723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.911696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee795e8-9881-470c-a81e-8ab8dcaaad88 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:05.949929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:05.950738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.951014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.951276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.952434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.959706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:05.961179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:05.978458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:05.979657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:05.980604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:05.984576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 425/841] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:05.985450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.992809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f394a0-eb71-4383-a07a-567325325ca7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.033065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.034092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.034460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.035086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.036158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.036634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.038926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03178-fbf4-4aaf-8a0f-5a88b7fb7be8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.078617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.100335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821858-8dfd-4173-8fa6-d09e52096c91 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.139087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.139924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.140199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.140466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.152377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.153876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:06.173487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:06.174459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:06.175365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:06.175365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:06.175365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:06.175365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:06.175365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 426/842] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:06.175660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.183828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 417/843] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.185181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba7e5-1eae-4c00-bfe2-bc2b01e62648 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.185442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba7e5-1eae-4c00-bfe2-bc2b01e62648 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.185747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba7e5-1eae-4c00-bfe2-bc2b01e62648 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.186964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 418/844] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:06.187669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba7e5-1eae-4c00-bfe2-bc2b01e62648 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.283531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a20368-254a-4b07-80ca-884cfb9c5841 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.290346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba7e5-1eae-4c00-bfe2-bc2b01e62648 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.318632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.320005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.320691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.320960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.321226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.322057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.322356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.323983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0952c0-1038-440b-9e60-96ae2a9b34ed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.325748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.327351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.328106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.328377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.328646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.329371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.329676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.331062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.342485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 419/845] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.347286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 427/846] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.347472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.347563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.347563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.347563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.363354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:06.364593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:06.463027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219170c1-0882-42bb-a171-a06d04c90dc6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.501947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.502612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.502884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.503151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.504027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.504331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.505799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.512783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 420/847] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.514056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.567366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 428/848] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:06.567366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.586267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.653320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf112e-e374-4998-a658-6cd7cfd1ef7a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.687574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2abee-315a-47b5-a4b0-63ca09d926ac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.696254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.696500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.696700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.696897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.705876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.707174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.716580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:06.721813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:06.723184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:06.724361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 421/849] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:06.725435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.739856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.740601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.740880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.741147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.816598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.818093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.844389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469735e8-ab2f-4c6c-ba70-6291b88633ec None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.858051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.882466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.883269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.883577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.883859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.884505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.885966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:06.897942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:06.899174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:06.900063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 422/850] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:06.900928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.932380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 429/851] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:06.932380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.957824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.021698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a24052-d7ad-420b-97bf-51e606f4d637 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.040926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f822b-9274-4c91-b9ba-e02dbbc2fdfe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.061618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.062395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.062688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.062938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.063811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.064117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.065913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.075910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.076588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.076867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.077136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.077844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.078147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.079536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.084625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 430/852] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:07.085401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.086234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 423/853] 10.222.0.82 () {56 vars in 1135 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:07.090284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.128935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.185464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.202853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f6e9-219a-4eff-b1a5-8669bdeed5eb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.210439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600002b-23a6-4d74-824a-dfa18685c83f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.241620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.242428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.242710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.242982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.249470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.250403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.250830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.251243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.252151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.252446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.253849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.254534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.256042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.267409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 424/854] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:07.267409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:07.276305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:07.277557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:07.278567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:07.278567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:07.278567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:07.278567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:07.282492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 431/855] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:07.283526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.399793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.405581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66226-e5d5-4195-b462-bdc63a7ddb3b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.412103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668219-faf5-4014-99a1-6280344e7806 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.446787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.447795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.448070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.448335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.450314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.451052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.451389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.451678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.452412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.452717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.454146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.462053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.469166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 432/856] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:07.474874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.536452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.538154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.598807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2bdfd-b98f-4e07-b3c6-75d2115f2406 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.635774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.636405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.636684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.637104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.645429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.646908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.658847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:07.663210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:07.664985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:07.665886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:07.666350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 425/857] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:07.669818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 433/858] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:07.672552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.675356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.736122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.781613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200baf-73d5-4183-8fea-cffeaa946397 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.787839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e23e-cb99-490c-8bd8-d2239eac4f56 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.817877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.818380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.818668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.818937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.819759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.820067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.821521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.826927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.827967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.828403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.828946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.834367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 434/859] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:07.841694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.844530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.846812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:07.876254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:07.877241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:07.878221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:07.878221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:07.878221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:07.878221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:07.878221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 426/860] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:07.884749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.944440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.965683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae08b-91ae-4ece-8e82-9f56e8cad2e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.995704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.997477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef49a45-c273-4cb9-bd42-eff3061a5f41 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:08.012235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.013300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.013655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.014031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.015487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=3df3d72eea444df9b8a8b945c3eb37b2) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:08.015825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.017324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.029607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 435/861] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/role_assignments?user.id=3df3d72eea444df9b8a8b945c3eb37b2&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:08.042881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.043545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.043822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.044091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.044838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:08.045138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.047336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.062180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 427/862] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:08.068099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:08.193086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0e82-8506-4f5b-a7a1-27ecf4c28ffd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:08.234037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.235199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.235509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.235783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.244751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.246242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:08.262950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:08.263962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:08.265021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 436/863] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:08.270438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:08.384937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce0e5-4030-4c4a-83af-3b7028d58d0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:08.396251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:08.421045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.422173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.422450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.422718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.423556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:08.423854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.425310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693601-4a33-48e9-bcf1-69bc155ddd87 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.443465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 428/864] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:08.445613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:08.500473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:08.559897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668732-bf0a-4454-9873-8ba04a14c960 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:08.594782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.595489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.595767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.596036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.596871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=8731b43dcbb644a9abde1b4b30f5911e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:08.597179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.598613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985f0f8-f82b-4e1e-afc7-faebbc48673a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.605635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 437/865] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:08 2022] GET /identity/v3/role_assignments?user.id=8731b43dcbb644a9abde1b4b30f5911e&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:08.695504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232104-06f1-4632-b829-68886d2d01a8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.695862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232104-06f1-4632-b829-68886d2d01a8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.696054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232104-06f1-4632-b829-68886d2d01a8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.697926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 429/866] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:08.704009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.704324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.704577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.726565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:08.727857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:08.810074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 438/867] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:08.832284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b232104-06f1-4632-b829-68886d2d01a8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:08.943948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b232104-06f1-4632-b829-68886d2d01a8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:08.982212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:08.983043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.983333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.983832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.984500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:08.985971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:08.999234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:09.000379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:09.001651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 430/868] 10.222.0.82 () {56 vars in 1132 bytes} [Wed Jul 20 19:12:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:09.006847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.052487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.130819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7459e0-1bdf-475f-9be3-62039faf10b8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.168752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.169742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.170104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.170375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.171588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:09.171899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.173448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b516dd9-705e-45d7-88b9-b580dbc51e62 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.180060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 439/869] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:09.186101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.222463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.296722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8cd2-ffcd-454d-b0ec-05ca8e4b97ab None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.332809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.333489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.333762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.334030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.334747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:09.335044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.336475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cebf43-236d-4892-a1df-e8c9c67e9537 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.342721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 431/870] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:09.500443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597adc3-4099-457c-88fb-59fab6d06aa0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.500968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597adc3-4099-457c-88fb-59fab6d06aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.501063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597adc3-4099-457c-88fb-59fab6d06aa0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.502765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 440/871] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:09.508769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a7c4-470b-4a65-aff6-60e12dc34916 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.509381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a7c4-470b-4a65-aff6-60e12dc34916 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.509881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a7c4-470b-4a65-aff6-60e12dc34916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.530143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-55a6a7c4-470b-4a65-aff6-60e12dc34916 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:09.531778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-55a6a7c4-470b-4a65-aff6-60e12dc34916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:09.623804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 432/872] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:09.645471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597adc3-4099-457c-88fb-59fab6d06aa0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.764632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.771504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597adc3-4099-457c-88fb-59fab6d06aa0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.809475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.810205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.810481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.810794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.811564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.812976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dd65c-4a0f-4d56-929c-b0b9705e768f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.829208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 441/873] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:10.329379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4728-ffd8-4f21-be51-9d291eff766d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.330268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4728-ffd8-4f21-be51-9d291eff766d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.330708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4728-ffd8-4f21-be51-9d291eff766d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.332686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 433/874] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:10.338495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.339118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.339620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.358336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:10.359948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:10.440736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 442/875] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:10.465407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4728-ffd8-4f21-be51-9d291eff766d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:10.507932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:10.609892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4728-ffd8-4f21-be51-9d291eff766d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:10.670920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:10.672154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.672433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.672708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.688603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:10.698912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:10.699986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:10.700883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:10.701821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 434/876] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:10.708540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:10.814433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:10.830732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c634ee-2e5a-4752-9392-c9dcd1f01866 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:10.868677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaa146-7374-4fae-a144-729238200852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:10.869335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa146-7374-4fae-a144-729238200852 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.869689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa146-7374-4fae-a144-729238200852 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.869979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa146-7374-4fae-a144-729238200852 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.870736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaa146-7374-4fae-a144-729238200852 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:10.871033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaa146-7374-4fae-a144-729238200852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:10.872460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaa146-7374-4fae-a144-729238200852 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:10.882356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 443/877] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:10.888055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:10.915927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aec31-8ab5-4beb-a5aa-b33b8b3c7944 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.916331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aec31-8ab5-4beb-a5aa-b33b8b3c7944 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.916538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aec31-8ab5-4beb-a5aa-b33b8b3c7944 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.918306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 444/878] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:10.923941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.924226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.924508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.941732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:10.942983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:10.996132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.016332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08f7a-41f7-429a-9b1d-b7ad2c1f6ee4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.050625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 445/879] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:11.067470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.067470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.067470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.067470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.080058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.080882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.081944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:11.101359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:11.102532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:11.103587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:11.103587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:11.103587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:11.103587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:11.105789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 435/880] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:11.111132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.183626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.208917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e31cb5-2cc9-4233-8c68-f4f2a19cabd5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.244174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce10c-3472-40a6-b0ac-4f078b1672aa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.246698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.247820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.248327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.248818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.249677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.251269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:11.264817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:11.265921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:11.266808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:11.269983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 446/881] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:11.275713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.299564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.300232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.300508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.300778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.301507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:11.301808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.304066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.316276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.327587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 436/882] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:11.328522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.404808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84c119-3729-4e32-b87f-ca1921fdd45c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.451180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.452326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.452810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.453327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.454355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:11.454851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.456673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.462872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 447/883] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:11.464287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f84e-44df-4b4c-b24b-2fe4641afac8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.469164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.479056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.509060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.510435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.510855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.511256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.519725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.521454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:11.539121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:11.540431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:11.541474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:11.549184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 437/884] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:11.550414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.588307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d761-b9e7-4340-a160-6e108043a9da None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.633721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.634502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.634688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.634966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.635719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:11.636028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.637452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e246c-d880-4875-bcf2-ee8044ebe26e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.645074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 448/885] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:11.645074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1cf5e-2f31-4ed7-a28f-6a335c07df87 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.645074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1cf5e-2f31-4ed7-a28f-6a335c07df87 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.645074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1cf5e-2f31-4ed7-a28f-6a335c07df87 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.646462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 449/886] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:11.652818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.653157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.654237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.674395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.676004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:11.677234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:11.736825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12408f-279b-4414-a748-05f4e051d224 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.765542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.779347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.779347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.779347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.779347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.779782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:11.780145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:11.780664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 450/887] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:11.781608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:11.799766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.804418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 438/888] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:11.810819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.920841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e420ac-8b58-4ab8-9720-c7ceb5e799cf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.935009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73d671-3e86-43a9-9f19-27c1449029a1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:11.941945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.961271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:11.961933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.962205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.962471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.000412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.000999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.001313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.001556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.002795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.004552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26374a-cb40-4934-bb5c-c02bf6384e39 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.027354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 451/889] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:11 2022] POST /identity/v3/services => generated 269 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:12.027354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080708e-bd8f-4a1d-b524-fdba7b4d563a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.027354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080708e-bd8f-4a1d-b524-fdba7b4d563a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.027354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080708e-bd8f-4a1d-b524-fdba7b4d563a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.030466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 452/890] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:12.053798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.054351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.054913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.088712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.091633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.092761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:12.095070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:12.223338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 453/891] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:12.223338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.245686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.262859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 439/892] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:12:12.271837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.295393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.387253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d198f-c2a2-4bee-a659-c75e44de68d5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.393257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32c35-4d3b-4d39-b0c6-7bc9e076f8c2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.429105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.431034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.431470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.432169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.443244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.444443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.444870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.445310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.446151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.447843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.456068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.458686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:12.473313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:12.474690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:12.476438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:12.477872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 454/893] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:12.483454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:12.495675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:12.497476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:12.498726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:12.498726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:12.498726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:12.498726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:12.509173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 440/894] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:12.511147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.541541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.598644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98752bc-2508-400b-9ffc-ae31b9368805 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.621495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.636265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.636953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.637230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.637545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.638228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:12.638504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.639952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.650386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 455/895] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:12.651553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.666495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9013c-074e-4a7f-9f16-f3a8fe9b800d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.705953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.707090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.707716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.708190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.709137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:12.709640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.711378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.729704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 441/896] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:12.731339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.775263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524362-c783-4fce-b1ba-e1dccbc85435 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.803635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.843332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.844635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.845151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.845637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.846971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:12.847708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.850475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.851899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57328920-3038-4f19-8762-3f6a52bd0849 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.867997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 456/897] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:12.872305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.886943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.894664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.895938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.896469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.896939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.904946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.906838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:12.922969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:12.923995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:12.924932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:12.927824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 442/898] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:12.933870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.041701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1671-2dae-45b7-8341-fef1a0277be5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.066500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9905-6f4b-46b6-9463-b102ae590982 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.081383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.082502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.082986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.083508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.084626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.085208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.086880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.103517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.104480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.104678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.104944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.105738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] RBAC: Adding query filter params (interface=public, service_id=56dc8fdb8ac04203a8fb2704336b4292, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.106044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.112147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.112974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 443/899] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:13.114192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.117990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 457/900] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/endpoints?service_id=56dc8fdb8ac04203a8fb2704336b4292&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:13.119203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.171945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.185677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.228979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97abb2-b03f-46e7-8d83-96b922644810 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.267396 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.268496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.268979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.269480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.270625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] RBAC: Adding query filter params (role.id=1d91868f6f5e447a8fe985d2cd47701b, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=3df3d72eea444df9b8a8b945c3eb37b2) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.271154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.272900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7710047-210a-4d6a-a503-eb469cea474d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.287621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f333d-ec25-4d66-afb2-57075d5f1ba2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.288127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 444/901] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/role_assignments?user.id=3df3d72eea444df9b8a8b945c3eb37b2&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=1d91868f6f5e447a8fe985d2cd47701b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:13.326839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.327478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.327756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.328025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.328775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.330241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976106c-0868-4513-8bf5-efaf8200dda3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.337615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 458/902] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/services => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:12:13.814306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e46d-2ac4-4868-a3be-85e76a3a47e8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.814936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e46d-2ac4-4868-a3be-85e76a3a47e8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.814936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e46d-2ac4-4868-a3be-85e76a3a47e8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.816543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 445/903] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:13.824029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0f11-4e89-42b8-b362-a3700bab0dd5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.824844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0f11-4e89-42b8-b362-a3700bab0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.825258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0f11-4e89-42b8-b362-a3700bab0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.842973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-240a0f11-4e89-42b8-b362-a3700bab0dd5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:13.844440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-240a0f11-4e89-42b8-b362-a3700bab0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:13.915484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 459/904] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:13.934651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e46d-2ac4-4868-a3be-85e76a3a47e8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.053188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e46d-2ac4-4868-a3be-85e76a3a47e8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.075703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.090448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.091131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.091442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.091749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.092665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.094706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86722799-d9a6-4966-8e3b-c7c6729a06ec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.113208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 446/905] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:13 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:14.297549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e750-6553-430e-8385-da96dd9a153e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.297932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e750-6553-430e-8385-da96dd9a153e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.298128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e750-6553-430e-8385-da96dd9a153e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.300000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 460/906] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:14.305822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.306117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.306389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.325880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:14.327583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:14.424454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 447/907] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:14.466099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7e750-6553-430e-8385-da96dd9a153e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.531073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.647435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7e750-6553-430e-8385-da96dd9a153e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.682950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.683855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.684140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.684455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.685165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.686739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:14.699938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:14.701019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:14.701907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 461/908] 10.222.0.82 () {56 vars in 1132 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:14.711378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.865876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.869703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e827aa-d6c1-4b0c-9a2b-68de4fd69511 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.908176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.908767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.909046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.909319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.910043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:14.910350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.911806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.917607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 448/909] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:14.923602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.025673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.028854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771dd0e-0fdd-4aba-b16a-50c279790a42 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.065975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.066868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.067147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.067443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.068155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.068462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.069854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.075834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 462/910] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:15.081546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.183229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695854-9338-4fa8-b02b-33a2745ff48f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.222307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.222977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.223259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.223560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.224364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] RBAC: Adding query filter params (interface=public, service_id=89f60d8dae5047699700e03095e5ee2e, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.224678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.226077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30653f30-14eb-4297-80b4-2d41f6a00638 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.234337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 449/911] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/endpoints?service_id=89f60d8dae5047699700e03095e5ee2e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:15.239598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.347968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247c6ce-a395-46d5-a5c8-59a2b8bc465a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.385693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.386366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.386641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.386911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.387634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.389018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddae74-d2ac-4d17-8739-e111d9330498 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.395813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 463/912] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:12:15.438811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0fbe5-ecc2-4a1f-b17a-d8a877d730ee None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.439503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0fbe5-ecc2-4a1f-b17a-d8a877d730ee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.439977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0fbe5-ecc2-4a1f-b17a-d8a877d730ee None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.441858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 450/913] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:15.447887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475ae9-7bac-4f65-845b-290e604cc7f6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.448206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475ae9-7bac-4f65-845b-290e604cc7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.448452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475ae9-7bac-4f65-845b-290e604cc7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.466967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-22475ae9-7bac-4f65-845b-290e604cc7f6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:15.468217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-22475ae9-7bac-4f65-845b-290e604cc7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:15.495214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.544217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 464/914] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:15.567279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0fbe5-ecc2-4a1f-b17a-d8a877d730ee None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.601683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.612205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516009-f40d-4123-aa07-6addfb2ffb1a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.612815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516009-f40d-4123-aa07-6addfb2ffb1a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.613288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516009-f40d-4123-aa07-6addfb2ffb1a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.615156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 465/915] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:15.620369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.620901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.621394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.646127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:15.648671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:15.693859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0fbe5-ecc2-4a1f-b17a-d8a877d730ee None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.732714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.733536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.733869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.734139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.746147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:15.748679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 466/916] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:15.759377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:15.760474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:15.761370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 451/917] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:15.763481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.771454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.866807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.882755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf66dbf-1b38-4e48-b1c4-9e584ef3a9d7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.902142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.925456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c25cb-f492-4342-bc96-745d9bfab432 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.935275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.937199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.937703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.938213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.939262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.939792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.941518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.956674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 467/918] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:15.958073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.963888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.964900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.965182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.965456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.966122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.967614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:15.980523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:15.981600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:15.982442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 452/919] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:15.988462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.073262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc95c3-4e58-478f-8b9d-5e74d33982b9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.101254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaea5f-0915-454e-98a8-2d9ecc9c7ba5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.111488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.112793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.113270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.113841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.127710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.129525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.139209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.139954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.140261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.140520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.141229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.141538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.142945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.148554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 453/920] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:16.149680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:16.150674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:16.151625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:16.151625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:16.151625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:16.151625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:16.154084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.155568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 468/921] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:16.156840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.160086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.177810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.268642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2e5d8-a3b1-43ae-8f4b-0ce9d19cb91a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.271296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716813b-167d-4f51-8e40-d51e2d5a618f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.305778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.306476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.306805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.307119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.307881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.308201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.309581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.310844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.311934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.312471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.312942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.313850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.314352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.315988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.322139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 454/922] 10.222.0.82 () {56 vars in 1114 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:16.322556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 469/923] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:16.328094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.329377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.394160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.421663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.436527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044beb8-1b8a-486c-91f7-396a7c3afbb1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.442178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1bc0-3610-4469-b578-dd361c0ff52c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.473438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499827-2706-417e-a497-787d61c72611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.474267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499827-2706-417e-a497-787d61c72611 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.474554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499827-2706-417e-a497-787d61c72611 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.474815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499827-2706-417e-a497-787d61c72611 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.476565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.477233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.477514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.477792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.478532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.480013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a230c-712f-4df6-aef9-71b02de0d5d4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.482912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2499827-2706-417e-a497-787d61c72611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.484284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2499827-2706-417e-a497-787d61c72611 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c2499827-2706-417e-a497-787d61c72611 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:16.500934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:16.501948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 470/924] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f9-bc93-4824-a8ea-44277bce895b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.508017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f9-bc93-4824-a8ea-44277bce895b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.508730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f9-bc93-4824-a8ea-44277bce895b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.509496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 471/926] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:16.509607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 455/926] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:16.510436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04549f9-bc93-4824-a8ea-44277bce895b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.511073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.519626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.519626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.530431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:16.531851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:16.625768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 456/927] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:16.649479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.694147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04549f9-bc93-4824-a8ea-44277bce895b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.721660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.731077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.744481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.745176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.746165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.746165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.746571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.746879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.748384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.767645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 472/928] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:16.776582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.783611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58bcc2-2226-4be5-b575-5748b17fc7ce None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.819380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.820617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.821093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.821571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.822459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.824114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:16.836638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:16.837704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:16.838646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:16.841582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 457/929] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:16.847354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.890052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8581d-e1bb-4805-98e7-3263b3db0684 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.926485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.927283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.927588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.927856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.938934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.940497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:16.963427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:16.964572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:16.965464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:16.965464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:16.965464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:16.965464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:16.969529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 473/930] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:16.971021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.979075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003a98-c0cb-4cde-ba85-a1754a3a9d36 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.012387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.015766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.030516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.031791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.032231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.032646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.033668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:17.034513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.036358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.054747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 458/931] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:17.055806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.104706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3331-dad2-45da-ba38-806e14daca27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.154883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.156448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.156892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.157304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.158178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:17.158719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.160837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.176509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735d68-e87b-426e-a608-be0c88cd61fc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.177565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 474/932] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:17.183124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.226284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.227362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.227835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.228296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.229290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:17.229860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.231566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.237447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 459/933] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:17.243521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.309662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.315871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.329293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5306c-20d4-4cbc-8f3c-056cbe299289 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.367980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdcf5-8870-4fd3-834f-57666ef242b9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.372754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.373838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.374311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.374814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.384849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.387123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:17.406139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:17.407134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:17.408067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:17.415706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 475/934] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:17.417471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.429075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.429951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.430233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.430509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.432283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] RBAC: Adding query filter params (interface=public, service_id=cab8860b9fb14e0e8ff919ac9b8f6731, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:17.432605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.434415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.443407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 460/935] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/endpoints?service_id=cab8860b9fb14e0e8ff919ac9b8f6731&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:17.455333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.556599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdea2-5846-425b-a6e8-a1c880290314 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.569275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be57ca-e35e-4dab-9e4b-85f13f87fe8d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.587998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.597196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.597869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.598146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.598413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.599196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:17.599529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.600977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f36d-0e19-4b61-a524-95ef35b9a86a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.609422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.610119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.610391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.610655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.611472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.612768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567fe16-32c7-43db-a1c3-7504641f1932 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.618881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 476/936] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:17.618881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a338d-3c74-4518-8494-3d9f29da8572 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.618881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a338d-3c74-4518-8494-3d9f29da8572 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.618881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a338d-3c74-4518-8494-3d9f29da8572 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.618881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 477/937] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:17.622280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a338d-3c74-4518-8494-3d9f29da8572 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.625913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 461/938] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:12:17.627381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.627806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.628213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.655580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.666416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:17.668499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:17.773537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 462/939] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:17.800774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a338d-3c74-4518-8494-3d9f29da8572 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.802706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.847664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.848493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.848770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.849050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/3df3d72eea444df9b8a8b945c3eb37b2/roles/1d91868f6f5e447a8fe985d2cd47701b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.851584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=3df3d72eea444df9b8a8b945c3eb37b2, role_id=1d91868f6f5e447a8fe985d2cd47701b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:17.853077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:17.872556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 478/940] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:17 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/3df3d72eea444df9b8a8b945c3eb37b2/roles/1d91868f6f5e447a8fe985d2cd47701b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:17.946941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d91e8-fb12-41c3-85b4-99213a37fe19 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.968530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.002443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.004495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.004958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.005376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.006459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.008202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:18.027465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:18.028819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:12:18.030550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:18.039518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 463/941] 10.222.0.82 () {56 vars in 1132 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:18.042831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.135360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.173021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97c8f2-58ca-4d47-b422-d40f4d68c949 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.212265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.212951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.213271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.213540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.214328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:18.214643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.216086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.226142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 479/942] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:18.227614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.372714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8823d-482b-429f-8c03-1fb94b0d0462 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.409324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.409916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.410193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.410462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.411182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:18.411513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.412925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5a02-a0f0-4486-9094-2d5638d9108a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.419058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 464/943] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:18.425235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.538778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f09-e5f9-4183-ad2b-739944058238 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.574771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.575483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.575816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.576093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.576869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.578281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00f2ea-cf24-4bcf-bcc6-b6338c22bed3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.583324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.605497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 480/944] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:18.693816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463633-7729-467a-8642-e5383af1fc9e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.694210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463633-7729-467a-8642-e5383af1fc9e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.694560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463633-7729-467a-8642-e5383af1fc9e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.696537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 465/945] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:18.702795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.703185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.703592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.722590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:18.723956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:18.811823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 481/946] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:18.835514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463633-7729-467a-8642-e5383af1fc9e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.886039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.959712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463633-7729-467a-8642-e5383af1fc9e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.996522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.997195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.997467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.997793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.998515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.000054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.001447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING keystone.server.flask.common [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:12:19.021098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.sql.core [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:12:19.021098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:12:19.021098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [parameters: {'id': '26dc364413fa443c8fdd3d5fa9b3ab98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:12:19.021098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80318) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26dc364413fa443c8fdd3d5fa9b3ab98.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26dc364413fa443c8fdd3d5fa9b3ab98. Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:19.038912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 19:12:19.039874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application yield resource Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise self.value Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application session.commit() Jul 20 19:12:19.040850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:12:19.042525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:12:19.043764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:19.045385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [parameters: {'id': '26dc364413fa443c8fdd3d5fa9b3ab98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.046781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:19.048881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26dc364413fa443c8fdd3d5fa9b3ab98. Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:19.050989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 466/947] 10.222.0.82 () {60 vars in 1140 bytes} [Wed Jul 20 19:12:18 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:19.056935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.163405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef75c9-a44b-4ee3-be7c-582fc72f2d7a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.184204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.206382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.207521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.207989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.208404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.216267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.217955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7e423e90-7825-42ac-a735-d10ed37169ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:19.232738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:19.233917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:19.235001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:19.237296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 482/948] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:19.243357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.351934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.358168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0dfae-6b92-46b9-87b6-08870077f3e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.397664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.398431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.398783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.399121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.399986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:19.400357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.402453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2775-e004-4640-a1c8-ca681580f0f1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.424883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 467/949] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:19.869735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2fb9-c748-437d-ad55-5c514032b256 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.870181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2fb9-c748-437d-ad55-5c514032b256 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.870280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2fb9-c748-437d-ad55-5c514032b256 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.872338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 483/950] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:19.878174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602d8a-39a6-4ba0-b99a-fc4807976704 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.878460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602d8a-39a6-4ba0-b99a-fc4807976704 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.878739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602d8a-39a6-4ba0-b99a-fc4807976704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.897114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bb602d8a-39a6-4ba0-b99a-fc4807976704 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:19.898551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bb602d8a-39a6-4ba0-b99a-fc4807976704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:19.971177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 468/951] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:19.993744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2fb9-c748-437d-ad55-5c514032b256 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.125870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2fb9-c748-437d-ad55-5c514032b256 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.160761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.161514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.161796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.162071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.162737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.164154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:20.177164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:20.178232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:20.179062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:20.180105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc430-6f94-416a-ad50-fd2e11fe8869 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.180105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc430-6f94-416a-ad50-fd2e11fe8869 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.180105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc430-6f94-416a-ad50-fd2e11fe8869 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.180623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 484/952] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:20.180703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 469/953] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:20.184874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.187631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.188130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.188597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.207217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:20.208948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:20.231270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.303440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fdd22-f77d-4dc1-8b73-f42ee75b67e1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.303668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 470/954] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:20.323241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.346490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.346894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.348136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.348562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.348978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.349858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:20.350321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.352129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.362612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 485/955] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:20.364209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.451907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6ff3-782a-4e2f-9290-80853df3430d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.471640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c349-1db2-44a6-aed8-ffee59595e50 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.480070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.501140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.502974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.503814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.504931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.517035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.517722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.518004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.518279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.519000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:20.519337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.520839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.525113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:20.530605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 486/956] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:20.535245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:20.536516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:20.537752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:20.538584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.542113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 471/957] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:20.547747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.635727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.663786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1e20-4c33-4f80-854d-0c2ae2902f96 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.671654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908c86-8d00-484e-9714-927201f15be4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.705077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.705716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.706047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.706407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.707416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:20.707726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.709159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.712886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.714046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.714522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.714987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.716132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.717763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab31fe3-a7d1-4546-b8da-4d89f918d345 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.724251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 472/958] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:20.725262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.741086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 487/959] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:20.859565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f4d6-6448-416f-b915-4bda4b878bb9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.865483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6a65-b164-4e53-814b-a3457938bf94 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.866125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6a65-b164-4e53-814b-a3457938bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.866602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6a65-b164-4e53-814b-a3457938bf94 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.868795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 488/960] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:20.875382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.876064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.876541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.895113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:20.896895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:20.911470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.912312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.912589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.912858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.916274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.929101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.930318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.930619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:20.954162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:20.955971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:20.958427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:20.958427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:20.958427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:20.958427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:20.958427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 473/961] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:20.962043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.012295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 489/962] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:21.035120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.113201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f864a0d-3f42-4a39-a816-a6e052165e11 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.176917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.178438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.179152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.179870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.181437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:21.183015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.185738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.194851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eccfe-5a9e-45e3-b6ac-76fc878c225b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.209077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 474/963] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:21.215438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.257621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.258999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.260320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.260320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.261345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.264082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.275165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:21.290583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:21.292052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:21.293077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:21.300839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 490/964] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:21.304984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.340196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176fc1-f181-4b54-adf9-2da22c5ac5a0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.345327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:21.378595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.379764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.380187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.380599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.389307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.391029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:21.407523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:21.408654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:21.409655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:21.416595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 475/965] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:21.417686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.490394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766420e-46d1-44a5-86ef-fbb83752aaf6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.522697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985e7b-9112-4df8-82a7-b7020b4f8baf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.530858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:21.553009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.553915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.554381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.554850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.555989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:21.556460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.558704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.561873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.562742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.563165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.563610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.564589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:21.565036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.566728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.571752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 491/966] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:21.575440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.591606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 476/967] 10.222.0.82 () {56 vars in 1149 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:21.592771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:21.715932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:21.722046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3829f-f02a-4f45-aea0-87d00d67f5b3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.735224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034575f-d4e3-41d1-9cbd-5d591c5371cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:21.761391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.762340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.762619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.762915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.772180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:21.772859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.773137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.773407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.774110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:21.774412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.775909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aa0b5-dfb7-4df0-b16c-ff2034a098fd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 492/968] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba6c7-f7c3-455c-88ea-5c4605de53d0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba6c7-f7c3-455c-88ea-5c4605de53d0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba6c7-f7c3-455c-88ea-5c4605de53d0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 493/969] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.791338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.792082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.808965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:21.810183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:21.813959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:21.859927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:21.861836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:21.907475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 494/970] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:21.955569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.006774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 477/971] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:22.014568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.067117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.089951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e57d4-ef8a-434b-9a75-6dca5412906c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.092270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.126293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.126980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.127263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.127571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.128297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.129814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.131532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING keystone.server.flask.common [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:12:22.134437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba51da2-0a13-4fe1-b192-e84c54dcd80c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.144656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:22.144656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:12:22.144656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [parameters: {'user_id': 'f3fe0c59e4e240b3b2841201aff04a60', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:12:22.144656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:22.152753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:22.153697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:12:22.159981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:12:22.160878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:22.161778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:22.162621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f3fe0c59e4e240b3b2841201aff04a60', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.165125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 19:12:22.167208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 495/972] 10.222.0.82 () {60 vars in 1131 bytes} [Wed Jul 20 19:12:21 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:22.171326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.192304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.193116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.193397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.193680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.207188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.209494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:22.232910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:22.233919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:22.235284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:22.235284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:22.235284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:22.235284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:22.239666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 478/973] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:22.240672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.311740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec00b-675c-4fe5-ad69-9217ddf64dd6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.358184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.359751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.360232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.360763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.373142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.374899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061716-fa95-43a3-b686-865ee91bf46f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.375410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.380199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.394500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:22.402643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:22.403626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:12:22.404576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:22.410680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 496/974] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:22.412670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.425983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.426656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.426934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.427241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.428491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:22.428798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.430540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.449720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 479/975] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:22.450777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.530239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d37e-8728-410c-88fe-eada14d1ad75 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.564075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f2d4-dbad-486f-9a9b-f1a8ee7aca9e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.566165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.566843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.567121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.567431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.568662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:22.568662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.569978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.603034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.604344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.604815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.605469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.611343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 497/976] 10.222.0.82 () {56 vars in 1101 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:22.626442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.628343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:22.656044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:22.657224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:22.658351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:22.660403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 480/977] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:22.666893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.744401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.790683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f32a1-b987-4107-8898-21d70a980b4a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.827938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.828534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.828823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.829098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.829892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:22.830260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.831805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098359d-51b5-467e-85e4-aa31ef6ee56e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.845268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 498/978] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:22.851269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.889988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.960650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5064bdb-9751-4608-933d-bd5ec64a2d06 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.011663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.012332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.012611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.012882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.013775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] RBAC: Adding query filter params (role.id=1d91868f6f5e447a8fe985d2cd47701b, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=3df3d72eea444df9b8a8b945c3eb37b2) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.014516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.015523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc592-b478-4f1f-99d4-9f8166581f1a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.031663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 481/979] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/role_assignments?user.id=3df3d72eea444df9b8a8b945c3eb37b2&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=1d91868f6f5e447a8fe985d2cd47701b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.130482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332877-31ef-444d-b743-f96703d09ef5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.130689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332877-31ef-444d-b743-f96703d09ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.130951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332877-31ef-444d-b743-f96703d09ef5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.132430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 499/980] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:23.138344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.138628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.138906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.156806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:23.158034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:23.232763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 482/981] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:23.256627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332877-31ef-444d-b743-f96703d09ef5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.369833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332877-31ef-444d-b743-f96703d09ef5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.389995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.409548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.410289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.410578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.410850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.411546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.412954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:23.426499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:23.427889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:23.428828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:23.431404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 500/982] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:23.434484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.469566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.542855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55a363-8dff-4c70-a510-d1ad6b508d70 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.581929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.582618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.582896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.583165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.583944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.584241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.585648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.591377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 483/983] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.597010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.714043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820e1b-e0b8-4606-a357-5dadc4ebde59 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.749805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.750492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.750775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.751052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.751809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.752117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.753539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462cd2-dccb-49ad-ba5f-7d42ae1d109b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.764173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 501/984] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.768189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.877541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.886262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e077-dc58-49b3-afd5-d4dd0469b897 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.894402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4534d9-d151-4aa3-976d-155680baaaf8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.894686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4534d9-d151-4aa3-976d-155680baaaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.894979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4534d9-d151-4aa3-976d-155680baaaf8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.896569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 502/985] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:23.901843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.902052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.902326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.919463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:23.921360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:23.928323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.928987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.929732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.930008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.930821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] RBAC: Adding query filter params (interface=admin, service_id=cab8860b9fb14e0e8ff919ac9b8f6731, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.931110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.932632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.938533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 484/986] 10.222.0.82 () {56 vars in 1249 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/endpoints?service_id=cab8860b9fb14e0e8ff919ac9b8f6731&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.943997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.972361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:24.006108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 503/987] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:24.045677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:24.073150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a2a9-641d-428a-ac53-cc5f2d762766 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.119670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.120449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.120767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.121029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.121898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.123302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04886764-d195-4d81-9f79-5dc364337259 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.139348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 485/988] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:12:24.193362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9cf7-e5e1-4dd5-b892-967137fa131c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.258828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.260168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.260640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.261092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.262411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.265335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56982b69-aef9-4da1-91bb-5f9b24d1fead None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.285254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 504/989] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:24 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:25.185527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c62a-25aa-4cdd-a8ad-c66615e9abab None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.186158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c62a-25aa-4cdd-a8ad-c66615e9abab None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.186158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c62a-25aa-4cdd-a8ad-c66615e9abab None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.187551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 486/990] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:25.194550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.195103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.195103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.213778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:25.215092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:25.250328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:25.312916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 505/991] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:25.335799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c62a-25aa-4cdd-a8ad-c66615e9abab None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.385877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:25.484587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c62a-25aa-4cdd-a8ad-c66615e9abab None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.524389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.525201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.525530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.525806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] PATH_INFO: `/v3/services/image` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.526472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.527912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:25.540857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:25.542209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:25.543217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 487/992] 10.222.0.82 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:25 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:25.552587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.697749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831df581-ebef-4943-917c-d516dacb5b8b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.749700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.750622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.751065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.751512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.752373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:25.752824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.754380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255b9b5-c17b-439f-8045-7df3a616642c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.760502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 506/993] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:25.767267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.872469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:25.900597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ec15-c6ad-4119-94f0-91d5aa062975 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.951544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.952224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.952502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.952771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.953494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] RBAC: Adding query filter params (type=image) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:25.953794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.955187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23260c3-a2bd-4cfe-a0e4-8693df85f620 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.960545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 488/994] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:26.252094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc289ec-674b-499e-8ccd-d44d8d3ee880 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.252797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc289ec-674b-499e-8ccd-d44d8d3ee880 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.252797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc289ec-674b-499e-8ccd-d44d8d3ee880 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.254337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 507/995] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:26.260377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1fbd-9e75-47ed-a207-c81cd3ca4c8c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.261309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1fbd-9e75-47ed-a207-c81cd3ca4c8c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.261309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1fbd-9e75-47ed-a207-c81cd3ca4c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.279951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4c8e1fbd-9e75-47ed-a207-c81cd3ca4c8c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:26.281185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4c8e1fbd-9e75-47ed-a207-c81cd3ca4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:26.382198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 489/996] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:26.404772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc289ec-674b-499e-8ccd-d44d8d3ee880 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.434628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:26.435150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d840-85bc-41ee-b559-e3d9153cade9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.435484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d840-85bc-41ee-b559-e3d9153cade9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.435833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d840-85bc-41ee-b559-e3d9153cade9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.437512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 490/997] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:26.442970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.443290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.443549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.461376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:26.462604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:26.532812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc289ec-674b-499e-8ccd-d44d8d3ee880 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:26.535265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 491/998] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:26.558399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.568849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:26.569666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.569962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.570240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.570529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:26.570891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:26.572467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:26.585757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:26.586803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:26.587713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 508/999] 10.222.0.82 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:26.593409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.680678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677f1ac-9a8f-4035-b5b6-c3e67c6284e9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:26.696565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:26.707770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e63b-99eb-4464-acdb-5eea0818c691 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:26.720157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:26.721070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.721347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.721617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.722271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:26.723710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:26.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:26.736957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:26.737824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 492/1000] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:26.743369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.751804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:26.752512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.753219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.753502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.754230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:26.754540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:26.756641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:26.762233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 509/1001] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:26.767648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.840601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:26.870800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f675-b2ae-44a6-8541-8cc6b156472a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:26.885518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f2b98-9ae4-4f9c-a7da-2ced861bcff4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:26.906617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:26.907285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.907596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.907870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.908575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:26.908884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:26.910264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:26.915055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 493/1002] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:26.921306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.923254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:26.924154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:26.924441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:26.925538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:26.926300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:26.926609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:26.928031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:26.939040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 510/1003] 10.222.0.82 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:26.940241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:26.966204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:27.034944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff594-ce3a-4a3a-951d-8bdb95f8620e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:27.047259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742589-6b72-4928-a126-9e9dbe41fa2d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:27.072215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:27.072924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:27.073209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:27.073484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:27.074308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:27.074901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:27.076148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:27.082907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:27.083697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:27.083987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:27.084261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:27.085026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:27.086475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:27.087649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 494/1004] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:27.088691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:27.092273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:27.115350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 511/1005] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:27.233008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3d58-9193-42f2-89ef-283f2becdd8c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:27.284188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:27.284861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:27.285128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:27.285420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:27.286235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] RBAC: Adding query filter params (interface=public, service_id=46801ef75cde41a59bda817e482470ff, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:27.286545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:27.287999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c2bd6-522a-483d-8dac-ee9a3d1a2495 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:27.294624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 495/1006] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:27 2022] GET /identity/v3/endpoints?service_id=46801ef75cde41a59bda817e482470ff&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:27.300851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:27.413196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:27.445941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da77c-b2a4-46bb-adbc-376f33f5daeb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:27.506640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:27.507728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:27.508245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:27.508761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:27.510157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:27.512903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6033c0-d054-4e82-9469-3deb62960c78 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:27.531381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 512/1007] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:27 2022] GET /identity/v3/services => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:12:28.056081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dc91-bc00-419d-b54a-ebfbc75ffbdf None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.056486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dc91-bc00-419d-b54a-ebfbc75ffbdf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.056668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dc91-bc00-419d-b54a-ebfbc75ffbdf None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.058212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 496/1008] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:28.063559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7ae-4f94-4b1b-bbd4-fed84edb9727 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.063856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7ae-4f94-4b1b-bbd4-fed84edb9727 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.064115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71c7ae-4f94-4b1b-bbd4-fed84edb9727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.081425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bb71c7ae-4f94-4b1b-bbd4-fed84edb9727 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:28.082621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bb71c7ae-4f94-4b1b-bbd4-fed84edb9727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:28.185884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 513/1009] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:28.209759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15dc91-bc00-419d-b54a-ebfbc75ffbdf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.294423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:28.352150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15dc91-bc00-419d-b54a-ebfbc75ffbdf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:28.389995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:28.390668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.390945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.391214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.391974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:28.393371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2441d5d-93db-40da-b9d8-c8a9c488a50b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:28.415350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 497/1010] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:28 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:29.286160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e11a-cdf1-4506-b166-910108b4a95d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.286704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e11a-cdf1-4506-b166-910108b4a95d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.286704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e11a-cdf1-4506-b166-910108b4a95d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.288329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 514/1011] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:29.294316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.294628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.295171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.313188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:29.314402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:29.412125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 498/1012] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:29.436569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e11a-cdf1-4506-b166-910108b4a95d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:29.517746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:29.556981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e11a-cdf1-4506-b166-910108b4a95d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:29.598988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:29.599865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.600177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.600407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.601699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:29.603179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacc7bd-c237-4183-a65b-b1689e3e3665 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:29.605309 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 515/1013] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:29.611166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:29.614795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b7a2-9d1f-4965-a3e3-bfedeff4a3f2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.615078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b7a2-9d1f-4965-a3e3-bfedeff4a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.615374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b7a2-9d1f-4965-a3e3-bfedeff4a3f2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.617034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 516/1014] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:29.624920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.625219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.625483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.643469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:29.647353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:29.680131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:29.747457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3a4b-b912-4ac8-b18f-06dad0addb2a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:29.779378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 517/1015] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:29.790401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:29.791127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.791431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.791710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.792639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:29.794156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:29.812790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:29.828175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 499/1016] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:29 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:29.956625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:29.996113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05487-99e9-4093-9e31-14b1900335e8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:30.037810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:30.038649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.038960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.039221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.039910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:30.041697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:30.055861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:30.056958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.057846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 518/1017] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:30.066693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:30.181550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:30.185326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57bc48-dda3-49fc-8395-164d90162ae3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:30.227079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:30.227788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.228072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.228346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.229171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:30.229496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:30.231610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:30.239286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 500/1018] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:30.248752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:30.387229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84d38-bf6d-4d9d-ba7a-9c824244aeef None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:30.423796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:30.424476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.424759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.425036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.425758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:30.426063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:30.427492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740dae-c867-4649-b2a7-ed3648bc7510 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:30.428971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:30.435614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 519/1019] 10.222.0.82 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:30.441435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:30.526674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1b7d-a105-414d-b921-30b202099cc0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.526972 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1b7d-a105-414d-b921-30b202099cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.527243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1b7d-a105-414d-b921-30b202099cc0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.528913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 520/1020] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:30.534577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.534887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.535110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.556363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:30.558000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:30.586005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4183-52c5-40b6-b3f7-56e7d73ff828 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:30.635378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:30.636191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.636551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.636919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.638108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:30.640217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:30.662434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 521/1021] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:30.670553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 501/1022] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:30.687416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:30.808145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c91be8-1ddd-4298-b92a-a5ebada547da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:30.844920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:30.868636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:30.869872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:30.870148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:30.870420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] PATH_INFO: `/v3/services/image` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:30.871082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:30.872539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:30.886620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:30.887758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:30.888663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:30.891451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 522/1023] 10.222.0.82 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:30 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:30.893702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:30.923055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.025709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbdf1d-1275-477e-96e0-6f7c55b75347 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.072655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.073352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.073631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.073900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.074631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] RBAC: Adding query filter params (name=image) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:31.074935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.076435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.082427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 502/1024] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.088237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.210612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7095b-5af6-4c6c-8950-303bf4cf8fea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.251620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.252313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.252597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.252874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.253609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:31.253916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.255374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.267432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 523/1025] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.269944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.371978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.394958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead634-144c-4754-a7a2-cac5a7a8d231 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.454768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.455967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.456454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.456948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.458504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] RBAC: Adding query filter params (interface=public, service_id=f4de1cad33144dc287870c0f0c3c8c1a, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:31.459080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.461841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c326da-c7cb-4539-83bd-6177871a8df0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.470783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 503/1026] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/endpoints?service_id=f4de1cad33144dc287870c0f0c3c8c1a&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.476569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.540722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.599775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66b18-0e73-499b-9712-c477dd3495e4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.651910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.652608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.652894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.653169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.653866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.655275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29f93b-099c-4add-8143-e31624a5256e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.671348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 524/1027] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/services => generated 1957 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:12:31.988772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375932-c562-4d6b-bd02-7f0144ad8c1b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.989168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375932-c562-4d6b-bd02-7f0144ad8c1b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.990232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375932-c562-4d6b-bd02-7f0144ad8c1b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.991033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 504/1028] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:31.998003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.998391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.998690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:32.018105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:32.019323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:32.103345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 525/1029] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:32.126342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd375932-c562-4d6b-bd02-7f0144ad8c1b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:32.242395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd375932-c562-4d6b-bd02-7f0144ad8c1b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:32.285781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:32.286584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:32.286862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:32.287135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:32.288371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:32.289854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aac3fa-79a3-481a-8900-9683a4729bdd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:32.294574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 505/1030] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:32.301100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:32.358226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:32.434846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40d58-2ec2-4f64-ba1d-76c7233c21db None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:32.476253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:32.476946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:32.477514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:32.477589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:32.478260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:32.480070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc883f8b-4957-4562-963f-8be7dcd6f756 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:32.507884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 526/1031] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:32 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:32.930800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7a670-441c-49bd-83a6-1fd1cf27fd2f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:32.931342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7a670-441c-49bd-83a6-1fd1cf27fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:32.931342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7a670-441c-49bd-83a6-1fd1cf27fd2f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:32.932930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 506/1032] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:32.938430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:32.938697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:32.938995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:32.956864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:32.958078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:33.035293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 527/1033] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:33.059140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7a670-441c-49bd-83a6-1fd1cf27fd2f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:33.080312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:33.180413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7a670-441c-49bd-83a6-1fd1cf27fd2f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:33.221668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:33.222484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.222779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.223033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.234780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:33.243033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:33.244255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:33.245137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:33.247789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 507/1034] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:33.250530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:33.285587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:33.367036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e17b4-0b15-4cda-9733-aa667d7f5724 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:33.403685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:33.404371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.404647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.404922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.405683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:33.405988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:33.407418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:33.422247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 528/1035] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:33.423150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:33.507781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:33.533447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0ef6-ce8f-4831-a163-56b0467b4c52 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:33.570332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:33.571184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.571494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.571767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.583068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:33.584580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:33.604546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:33.605665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:33.612022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:33.612022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:33.612022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:33.612022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:33.612022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 508/1036] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:33.612321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:33.726843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:33.735023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641daf2c-5f77-4bb4-ae09-ba8f7dfb9138 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:33.781944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:33.782543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.782827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.783104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.783880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:33.784192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:33.785638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ac242-927a-4c4f-9282-485c4335b21f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:33.799713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 529/1037] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:33.805294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:33.913845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952b53-c558-4d38-95c0-41d687f5caf8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:33.932609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066d94-e442-469d-8ee2-296b00828116 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.932909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066d94-e442-469d-8ee2-296b00828116 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.933224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066d94-e442-469d-8ee2-296b00828116 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.935160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 530/1038] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:33.940708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.940990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.941296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.943931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:33.953970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:33.954806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:33.955072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:33.955366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:33.958497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:33.959717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:33.963715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:33.965207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:33.979885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:33.980946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:33.981915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:33.986141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 509/1039] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:33.986944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.031081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 531/1040] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:34.054457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.100005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f458ba-d08d-4f67-a267-9d31504e5869 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.138401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.139101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.139435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.139713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.140576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:34.140892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.142391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.150591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.166612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 510/1041] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:34.168058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.175829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5368b-208b-4e92-939a-ccfbaa6a60a4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.214784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.215622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.216012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.216476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.217474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.218735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.220247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:34.234194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:34.235494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:34.236437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 532/1042] 10.222.0.82 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:34.243387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.297691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af79d-f45c-4c4e-8073-c7e0073b6d95 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.338912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.339601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.339955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.340234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.386198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8245d-8758-42c7-b054-29820f417b8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.426060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.426753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.427108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.427467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.427598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.428576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:34.428989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.429746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.430824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.437196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 533/1043] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:34.444165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.461030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.487373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.554474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 511/1044] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:12:34.560597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.569741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05faad-53ab-41b0-86e6-bd27f78e2474 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.631046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.632189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.632688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.633185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.634471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:34.635096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.637778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ec0f-17e4-4e0f-b132-c81c41f1e697 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.651566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 534/1045] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:34.656589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa03ce-44e5-453b-a5a9-f83cd7f8008c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.656876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa03ce-44e5-453b-a5a9-f83cd7f8008c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.657148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa03ce-44e5-453b-a5a9-f83cd7f8008c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.658562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 535/1046] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:34.659401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa03ce-44e5-453b-a5a9-f83cd7f8008c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.697262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53e0c-72c5-4046-90eb-7c7e0f883dfc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.733818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.734629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.734905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.735171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.747657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.749431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.762892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-cac0da75-9b50-4708-883a-f3c39c628f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:34.777046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:34.778081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:34.778990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:34.778990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:34.778990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:34.778990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:34.779213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.779287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 512/1047] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:34.780356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.780635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.780963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.798291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:34.799537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:34.821294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa03ce-44e5-453b-a5a9-f83cd7f8008c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.862320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.863008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.863297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.863606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.864379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.865854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.873515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 513/1048] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:34.875585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.890091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 536/1049] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:34.899098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.053428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acb66a-143b-437f-bb2d-d5245a4df636 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.065451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992173e9-0ba7-4cab-9691-9ce3b36cb84b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.089140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.099562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.100249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.100530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.100813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.101559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:35.101863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.104232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.114282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.118150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 514/1050] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:35.125517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.130170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.131561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.132051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.132529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.150202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:35.157971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:35.159155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 537/1051] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:35.167633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.297276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181847f-80e2-4378-b955-8f477f2be087 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.335999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.336829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.337095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.337366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.344305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85d1f-bfe7-49b6-9d1f-15a54c028f9d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.345766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.347248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:35.362515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:35.364328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:35.366091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 515/1052] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:35.374280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.404667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.406776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.406776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.406776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.406776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:35.407092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.408699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.418205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 538/1053] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:35.424858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.455872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.520913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26121c5-eda2-4f37-a464-06a9c9645dc0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.524671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.563960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.564663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.564934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.565203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.566008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:35.566312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.567991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.584028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 516/1054] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:35.590202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.613959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b582e-9024-445c-a4ba-b37da39ffc8f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.674888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.676641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.677141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.677802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] PATH_INFO: `/v3/users/11097b79663547f1b87a6c621d3b0d47` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.698271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] RBAC: Authorizing `identity:get_user(user_id=11097b79663547f1b87a6c621d3b0d47)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.701372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.710282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 539/1055] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/users/11097b79663547f1b87a6c621d3b0d47 => generated 285 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:35.712043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:35.751710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3544-5217-432a-b5ca-96bbfce4127d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.762836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.804759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.805432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.805815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.806010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.806912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] RBAC: Adding query filter params (role.id=1d91868f6f5e447a8fe985d2cd47701b, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:35.807280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.809024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.815292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 517/1056] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=1d91868f6f5e447a8fe985d2cd47701b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:35.844480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc297-46b9-4233-bb76-ca6ab94da300 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.856881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.889380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.890066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.890346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.890620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.980549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.982029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:36.132749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 540/1057] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:12:36.139124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:36.306336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560d689-b137-42ed-90f0-dcf9015a095e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:36.358531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:36.359679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:36.360103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:36.360503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:36.362051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:36.364085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305d90b-898a-4c3e-9165-b1a5c42073ce None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:36.366506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 518/1058] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:36 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:36.373582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:36.385621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:36.495959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b33f-97e9-49a9-990c-eede8afbec8e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:36.536267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:36.536949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:36.537226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:36.537499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:36.538366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user.id=11097b79663547f1b87a6c621d3b0d47) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:36.538676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:36.540197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f64b-f5df-4aca-aee7-c8e787d9b0a6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:36.547396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 541/1059] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:36 2022] GET /identity/v3/role_assignments?user.id=11097b79663547f1b87a6c621d3b0d47&scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:37.033252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a4cf-8d9a-4333-895e-802786aa6504 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.033747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a4cf-8d9a-4333-895e-802786aa6504 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.034233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a4cf-8d9a-4333-895e-802786aa6504 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.036873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 519/1060] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:37.043468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.044306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.044306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.070363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:37.072615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:37.194385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 542/1061] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:37.227820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a4cf-8d9a-4333-895e-802786aa6504 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:37.301937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:37.400345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a4cf-8d9a-4333-895e-802786aa6504 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:37.456891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:37.458252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.458866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.459500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.577888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:37.580407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c7915-3efc-4d84-b1a4-074ab27f44f4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:37.634768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:37.724876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 520/1062] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:37.732184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:37.742758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:37.899009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e857-6cd9-42c3-a3a1-e48e9e53e459 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.899344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e857-6cd9-42c3-a3a1-e48e9e53e459 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.900038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e857-6cd9-42c3-a3a1-e48e9e53e459 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.902893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 521/1063] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:37.911253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.911804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.911995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.924822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458733ae-b345-4e29-b59a-443809f95f16 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:37.930104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:37.931341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:37.980144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:37.980977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.981260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.981530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.993354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:37.994946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:38.015903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:38.016985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:38.017967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:38.017967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:38.017967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:38.017967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:38.019844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 543/1064] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:38.030333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:38.045402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 522/1065] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:38.084596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:38.100268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:38.171433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fd895-bc5d-43b2-be32-16112b2db850 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:38.189272 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:38.220234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:38.221144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.221566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.222004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.223394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:38.223857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:38.226379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:38.255372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 544/1066] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:38.255676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d67c-9664-470e-b09e-d30c02a42938 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:38.314532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:38.315430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.315743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.315993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.330252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:38.338963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:38.341343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:38.343720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 523/1067] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:38.347792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:38.497704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ad53-84e8-4ae3-bba2-341089191997 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:38.514157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:38.538046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:38.538762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.539040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.539335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.540120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:38.540434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:38.541954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:38.552552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 545/1068] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:38.559203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:38.726637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87017f-7d84-4248-bb6f-17b58c0f1dd9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:38.762295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:38.769036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:38.769934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.770212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.770480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.783817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:38.785319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-48ecac4f-e7c8-47ad-8330-bc5021517f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:38.805081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:38.806856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:38.808616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:38.808616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:38.808616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:38.808616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:38.808616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 524/1069] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:38.816585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:38.851897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451adcef-bfae-4549-8131-f1e13e663116 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.852239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451adcef-bfae-4549-8131-f1e13e663116 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.852507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451adcef-bfae-4549-8131-f1e13e663116 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.853948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 525/1070] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:38.859931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:38.860219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:38.860439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:38.879849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:38.881055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:38.964891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 526/1071] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:38.975826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659dea4-558a-4a25-9e57-122a09cd4a65 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:38.988160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.018252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.018819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.019094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.019407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.020160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:39.020512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.022036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.037428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 546/1072] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:39.051198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.099830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.120769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b865-2fd3-4631-abc1-ef5fc662d10a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.135797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.169235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.170192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.170894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.171241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.184224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc620786-6a19-40a3-bf9a-f4ba6935de2d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.187693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:39.195619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:39.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:39.200882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 527/1073] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:39.207226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.224630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.225888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.226164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.226454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.234633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.236349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:39.262410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:39.263755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:39.264715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 547/1074] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:39.272220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.355291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977869c-60ab-49ee-b3b5-17a827117bc2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.397121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.397852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.398128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.398417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.399193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:39.399539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.401079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.401249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.409398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc770262-ef97-4444-a796-7f4f723474ba None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.411339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 528/1075] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:39.422336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.460354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.461054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.461331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.461608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.462460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:39.462838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.464372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.466306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.495566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 548/1076] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:39.496984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.552344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d95c2-8646-45b5-b8ec-b207ab160308 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.605674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.606565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.606845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.607115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] PATH_INFO: `/v3/users/11097b79663547f1b87a6c621d3b0d47` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.608617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] RBAC: Authorizing `identity:get_user(user_id=11097b79663547f1b87a6c621d3b0d47)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.610101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.620079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 529/1077] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/users/11097b79663547f1b87a6c621d3b0d47 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:39.623817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.631725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f4bbc-c457-4ad9-9a30-6925b8936c68 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.674878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.675837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.676110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.676388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.688673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.690184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:39.709202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:39.710962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:39.712717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:39.712717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:39.712717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:39.712717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:39.712717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 549/1078] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:39.718114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.728161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.770714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b0d8-d349-420e-accd-042aef879e50 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.772588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.817706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.818496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.818774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.819041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.820579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.822211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.832406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 530/1079] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:39.833890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.841279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c45a1-468c-434f-aeda-4894f270c346 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.893805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881658b-c714-4a0a-a538-57760992861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.894497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881658b-c714-4a0a-a538-57760992861d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.894786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881658b-c714-4a0a-a538-57760992861d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.895054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881658b-c714-4a0a-a538-57760992861d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.895841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881658b-c714-4a0a-a538-57760992861d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:39.896151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881658b-c714-4a0a-a538-57760992861d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.897604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881658b-c714-4a0a-a538-57760992861d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.912158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 550/1080] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:39.918743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881658b-c714-4a0a-a538-57760992861d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.985047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac290d-603c-4dba-b727-a8346bc2642c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:40.000000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:40.026901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:40.027851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:40.028130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:40.028402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb/users/11097b79663547f1b87a6c621d3b0d47/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:40.030557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] RBAC: Authorizing `identity:create_grant(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user_id=11097b79663547f1b87a6c621d3b0d47, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:40.032088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:40.039191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881658b-c714-4a0a-a538-57760992861d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:40.049530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 531/1081] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:39 2022] PUT /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb/users/11097b79663547f1b87a6c621d3b0d47/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:40.095695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:40.097010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:40.097496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:40.097981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:40.109083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:40.111221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:40.128663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:40.130094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:40.131748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 551/1082] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:40.140473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:40.181110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:40.283147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fff358-571b-4a9c-9638-f106285adf0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:40.360773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:40.362338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:40.362474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:40.362885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:40.363795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:40.364107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:40.365625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6eb3-197f-4f32-b233-ff32f622224f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:40.383601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 532/1083] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:40.386986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:40.545047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a330-9b9c-41e1-9914-de371f6ae7b8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:40.583060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:40.600124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:40.601840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:40.602346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:40.602830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/1d91868f6f5e447a8fe985d2cd47701b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:40.606666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=ab9ee3d95d2549159195ce82240f16ea, role_id=1d91868f6f5e447a8fe985d2cd47701b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:40.609455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a953ae-8c46-429f-80a6-b03aa5cedb56 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:40.632711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 552/1084] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:40 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/ab9ee3d95d2549159195ce82240f16ea/roles/1d91868f6f5e447a8fe985d2cd47701b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:42.142369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6223a-9298-4c66-b99e-505b1f21002c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.142977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6223a-9298-4c66-b99e-505b1f21002c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.142977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6223a-9298-4c66-b99e-505b1f21002c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.144303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 533/1085] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:42.149836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.150308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.150399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.168465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:42.169681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:42.244767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 553/1086] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:42.268306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6223a-9298-4c66-b99e-505b1f21002c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.365349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.377428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6223a-9298-4c66-b99e-505b1f21002c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.413469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.414161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.414434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.414706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.426180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:42.434049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:42.435286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:42.436666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 534/1087] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:42.442332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.552432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f42a18-a7b3-4d74-98d4-536ae6ea1a14 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.570330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.590611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.591320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.591610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.591883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.592643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:42.592955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.594353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:42.603544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 554/1088] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:42.612097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.727556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5964-9560-44b7-a1ac-c4138d5b4aa8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.762145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.763025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.763331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.763615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] PATH_INFO: `/v3/users/11097b79663547f1b87a6c621d3b0d47` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.764853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] RBAC: Authorizing `identity:get_user(user_id=11097b79663547f1b87a6c621d3b0d47)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.766312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40787742-12e9-4a40-bef9-728a0dea3ecb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:42.768092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 535/1089] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/users/11097b79663547f1b87a6c621d3b0d47 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:42.774030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.878781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446d20-f225-45fc-890b-38d2eca048a3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.912264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.912914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.913196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.913468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.931892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d397-bc5a-4b42-8be8-638394c43892 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.932204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d397-bc5a-4b42-8be8-638394c43892 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.932475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d397-bc5a-4b42-8be8-638394c43892 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.933872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 536/1090] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:42.938973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.939256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.939573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.957667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:42.958896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:42.960324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.973464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.984213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.985631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.027892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 537/1091] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:43.051756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.082985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 555/1092] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:43.089054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.158890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1a09-7623-4599-94e3-9af41df49c62 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.176320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.197338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.198260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.198429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.198691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.199762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5c322-7480-4a2b-8470-222740c5ac93 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.210059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:43.218531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:43.219717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:43.222540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 538/1093] 10.222.0.82 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:43.226023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.237941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.238273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.239162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.239487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.239791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.243099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.244699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.246445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 556/1094] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:43.255798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.337759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb9ca1-501f-4f03-97ab-7389c050dea8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.364056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6c27-cafc-44dc-9c31-eafcf04323c0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.373329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.374008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.374289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.374563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.375348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:43.375665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.377066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.386431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 539/1095] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:43.392400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.403338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.404027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.404308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.404579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.405392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user.id=11097b79663547f1b87a6c621d3b0d47) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:43.405700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.407152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.414195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 557/1096] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/role_assignments?user.id=11097b79663547f1b87a6c621d3b0d47&scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:43.471785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.508646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57d92f-2ab1-42de-b5c1-3fa2d6927a5e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.551949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.553059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.553334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.553598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.567848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.569437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:43.589199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:43.590720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:43.591693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:43.591693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:43.591693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:43.591693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:43.591693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 540/1097] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:43.596901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.615737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.712611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263b2b-2a5a-4b30-a7c2-87dcce0750df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.747755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.748422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.748719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.748997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.749733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:43.750042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.751489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.764918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 558/1098] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:43.770797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.878520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977c3dd-332f-4c0d-808f-d2b657b0caf1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.908415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.928430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.929095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.929390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.929664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.939355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.941611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:43.956501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:43.957553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:12:43.958965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 541/1099] 10.222.0.82 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:43.963862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:44.035112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:44.067484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccebcb-0a92-42c6-ae70-0312b75d4db7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:44.102624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:44.103337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:44.103631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:44.103900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:44.104730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:44.105028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:44.106450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:44.124247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 559/1100] 10.222.0.82 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:44.130127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:44.233683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853e2c-4288-489e-8229-bdc67727d481 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:44.269218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:44.269949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:44.270230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:44.270512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:44.319383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:44.339474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:44.341033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:44.444819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 542/1101] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:44.451080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:44.553091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e6a8d-b287-463e-a511-bfed57214045 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:44.582310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:44.591333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:44.592347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:44.592631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:44.592912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:44.603898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:44.605381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:44.623287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:44.624269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:44.625231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:44.625231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:44.625231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:44.625231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:44.627492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 560/1102] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:44.630644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:44.721159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:44.739857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59488f-1f52-46ce-8e4e-bfe9cda77b0a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:44.777777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:44.778448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:44.778728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:44.779001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:44.779761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:44.780064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:44.781477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:44.793581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 543/1103] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:44.799809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:44.902873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efa12-ee06-4985-b78a-3fc13a785724 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:44.948184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e215e-96db-4206-a171-23d3531af736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:44.949259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e215e-96db-4206-a171-23d3531af736 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:44.949639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e215e-96db-4206-a171-23d3531af736 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:44.950007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e215e-96db-4206-a171-23d3531af736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:44.958044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e215e-96db-4206-a171-23d3531af736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:44.959549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e215e-96db-4206-a171-23d3531af736 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-151e215e-96db-4206-a171-23d3531af736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:44.976929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:44.977902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:44.978935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:12:44.983507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 561/1104] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:44.986394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.092349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb860c-fe66-4bab-a38e-93199c60294f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.130462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.131145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.131456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.131730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.132528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:45.132836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.134295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89c3a-ad77-4aeb-9f06-7bac0fbd4340 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.147781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 544/1105] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.154358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e215e-96db-4206-a171-23d3531af736 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.200990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:45.263883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e215e-96db-4206-a171-23d3531af736 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.301139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.302235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.302235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.302441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.303154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] RBAC: Adding query filter params (role.id=1d91868f6f5e447a8fe985d2cd47701b, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=ab9ee3d95d2549159195ce82240f16ea) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:45.303495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.304943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97265580-edda-4b37-91fd-048993d91a19 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.312075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 562/1106] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/role_assignments?user.id=ab9ee3d95d2549159195ce82240f16ea&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=1d91868f6f5e447a8fe985d2cd47701b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.525338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d93a-e965-4cb7-99b0-dbe1ae345dc5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.525878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d93a-e965-4cb7-99b0-dbe1ae345dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.525878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d93a-e965-4cb7-99b0-dbe1ae345dc5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.527251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 545/1107] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:45.533071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.533589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.533676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.551712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:45.552906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:45.630437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 563/1108] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:45.655279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d93a-e965-4cb7-99b0-dbe1ae345dc5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.658375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:45.767198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d93a-e965-4cb7-99b0-dbe1ae345dc5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.809908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.810116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.810330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.810489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.811768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.813240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234eed93-75a5-4eae-bec3-5aa3ac802a2a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.814892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 546/1109] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.821091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.856067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:45.924983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b2cc-7e96-4b18-a905-e1fb00f0322c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.960930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.961606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.961897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.962165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.962967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.964459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b8e92-63b7-489e-b118-daf963184621 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.989131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 564/1110] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:45 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:48.067722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54dcd-002b-48b3-8e7d-e7701744e220 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.068593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54dcd-002b-48b3-8e7d-e7701744e220 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.068593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54dcd-002b-48b3-8e7d-e7701744e220 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.070797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 547/1111] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:48.077090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.077521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.077640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.105372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:48.106574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:48.182390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 565/1112] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:48.206099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e54dcd-002b-48b3-8e7d-e7701744e220 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.291544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:48.327804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e54dcd-002b-48b3-8e7d-e7701744e220 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.364733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.365591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.365866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.366134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] PATH_INFO: `/v3/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.367750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] RBAC: Authorizing `identity:get_role(role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:48.369505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:48.370931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 548/1113] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/roles/300694bf267d40f9898c40333aa080ec => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:48.380642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.410998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:48.492502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c690e-0b8e-4b62-a2bb-2f7507a186cc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.527651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.528524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.528809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.529088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] PATH_INFO: `/v3/users/a49965d7876e40579630521d05542cfb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.545808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] RBAC: Authorizing `identity:get_user(user_id=a49965d7876e40579630521d05542cfb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:48.547269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:48.549080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 566/1114] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/users/a49965d7876e40579630521d05542cfb => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:48.558555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.688290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574771-cc5c-4564-ac32-d1074bd624a9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.725990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.726649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.726937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.727208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.736886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:48.800770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:48.802244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:48.907015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 549/1115] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:48.913194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:49.000627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:49.024303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b424-2025-4789-9786-2f3469304572 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:49.065246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:49.066117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:49.066389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:49.066672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:49.068008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:49.069456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df77e-7478-488d-a89c-6b96f2ed29eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:49.071219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 567/1116] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:49.081369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:49.126739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:49.193935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07264bc-5378-478e-aa5e-4a1d400e1405 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:49.232754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:49.233399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:49.233673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:49.233941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:49.234788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user.id=a49965d7876e40579630521d05542cfb) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:49.235094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:49.236565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4565b3-7c26-4762-856b-0f9b3b18bf1d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:49.242208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 550/1117] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:49 2022] GET /identity/v3/role_assignments?user.id=a49965d7876e40579630521d05542cfb&scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb&role.id=300694bf267d40f9898c40333aa080ec => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:51.238551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1332-2fcd-4c59-8341-2158e4451f8a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.239177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1332-2fcd-4c59-8341-2158e4451f8a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.239177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1332-2fcd-4c59-8341-2158e4451f8a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.240632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 568/1118] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:51.247253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.247844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.248153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.268775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:51.269990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:51.343791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 551/1119] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:51.367097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1332-2fcd-4c59-8341-2158e4451f8a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:51.478299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1332-2fcd-4c59-8341-2158e4451f8a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:51.514408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:51.515187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.515506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.515779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] PATH_INFO: `/v3/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.517323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] RBAC: Authorizing `identity:get_role(role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:51.518723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:51.520169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 569/1120] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:51 2022] GET /identity/v3/roles/300694bf267d40f9898c40333aa080ec => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:51.526407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:51.566316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:51.641601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72741-03c7-47aa-9fe8-1e5982359811 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:51.677942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:51.678823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.679101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.679401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] PATH_INFO: `/v3/users/a49965d7876e40579630521d05542cfb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.680611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] RBAC: Authorizing `identity:get_user(user_id=a49965d7876e40579630521d05542cfb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:51.682204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:51.683892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 552/1121] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:51 2022] GET /identity/v3/users/a49965d7876e40579630521d05542cfb => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:51.690489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:51.708114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:51.802306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564064-4b13-43a8-9314-0ae1bb41c76c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:51.837942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:51.838864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.839154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.839462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.840765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:51.842259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9864e-a348-4210-ba93-6683e5d049e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:51.844130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 570/1122] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:51 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:51.850575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:51.954508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:51.957671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85bb09-e1ca-4ddd-b923-325f3e51782c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:51.995126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:51.996030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.996480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.996480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb/users/a49965d7876e40579630521d05542cfb/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.998999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] RBAC: Authorizing `identity:create_grant(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user_id=a49965d7876e40579630521d05542cfb, role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:52.000495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf093-bc01-4b70-ae48-18e099826490 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:52.017822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 553/1123] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:51 2022] PUT /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb/users/a49965d7876e40579630521d05542cfb/roles/300694bf267d40f9898c40333aa080ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:54.054843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379079d1-8739-4069-821f-378cff1653c9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.055748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379079d1-8739-4069-821f-378cff1653c9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.055748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379079d1-8739-4069-821f-378cff1653c9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.057993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 571/1124] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:54.063516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.064044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.064044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.083055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:54.084267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:54.154445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 554/1125] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:54.187877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379079d1-8739-4069-821f-378cff1653c9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:54.290260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:54.312768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379079d1-8739-4069-821f-378cff1653c9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:54.347859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:54.348707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.348987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.349255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] PATH_INFO: `/v3/roles/300694bf267d40f9898c40333aa080ec` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.350902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] RBAC: Authorizing `identity:get_role(role_id=300694bf267d40f9898c40333aa080ec)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:54.352686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:54.353940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 572/1126] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:54 2022] GET /identity/v3/roles/300694bf267d40f9898c40333aa080ec => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:54.364039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:54.466801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:54.481048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464745c4-5acd-4c32-a0f8-6d349d29ceaf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:54.519352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9106b-593c-4437-9485-e22928559516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:54.520262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9106b-593c-4437-9485-e22928559516 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.520579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9106b-593c-4437-9485-e22928559516 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.520844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9106b-593c-4437-9485-e22928559516 None admin] PATH_INFO: `/v3/users/a49965d7876e40579630521d05542cfb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.522110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9106b-593c-4437-9485-e22928559516 None admin] RBAC: Authorizing `identity:get_user(user_id=a49965d7876e40579630521d05542cfb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:54.523634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9106b-593c-4437-9485-e22928559516 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:54.525553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 555/1127] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:54 2022] GET /identity/v3/users/a49965d7876e40579630521d05542cfb => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:54.532806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:54.655685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455547f-bf87-41c0-afde-c1a08f6998dd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:54.697569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:54.698243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.698711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.698983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.722053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:54.788446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:54.789926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:54.902040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 573/1128] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:54.909701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9106b-593c-4437-9485-e22928559516 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:55.015790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9106b-593c-4437-9485-e22928559516 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:55.051343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:55.052193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:55.052469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:55.052738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] PATH_INFO: `/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:55.054033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] RBAC: Authorizing `identity:get_project(project_id=0373bb78ef23494aa1e5ec5b7ba2f9fb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:55.055501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dde6dc-7252-4b0c-a650-f9dd0d21c456 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:55.057206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 556/1129] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:54 2022] GET /identity/v3/projects/0373bb78ef23494aa1e5ec5b7ba2f9fb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:55.063976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:55.115514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:55.174666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36c5f-cb8c-456b-aab7-798fe4c269c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:55.211397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:55.212056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:55.212338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:55.212610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:55.213555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] RBAC: Adding query filter params (role.id=300694bf267d40f9898c40333aa080ec, scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb, user.id=a49965d7876e40579630521d05542cfb) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:55.213842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:55.215345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156ac0-0ce0-43f7-ae00-9e0a9d97a1da None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:55.221479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 574/1130] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:55 2022] GET /identity/v3/role_assignments?user.id=a49965d7876e40579630521d05542cfb&scope.project.id=0373bb78ef23494aa1e5ec5b7ba2f9fb&role.id=300694bf267d40f9898c40333aa080ec => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:57.293863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce9b-832f-4a44-a8a7-d1c64737f295 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.294758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce9b-832f-4a44-a8a7-d1c64737f295 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.294758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce9b-832f-4a44-a8a7-d1c64737f295 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.297221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 557/1131] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:57.302724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.303151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.303238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.321638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:57.324073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:57.395336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 575/1132] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:57.419419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce9b-832f-4a44-a8a7-d1c64737f295 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:57.448095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:57.529692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce9b-832f-4a44-a8a7-d1c64737f295 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:57.569515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:57.570215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.570486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.570752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.572103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:57.573688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959c0d-7766-4aa3-8743-30d47a484507 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:57.575327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 558/1133] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:57.582143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:57.633806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:57.695630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec1a8f-74f6-4142-a9b4-4ae1bf9d378f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:57.733719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:57.734372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.734649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.734923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.735668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:57.737119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8f0dd-f12a-436f-96e0-06b3fb13fa3d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:57.765746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 576/1134] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:57 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:59.818218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4cb8-6807-4173-825a-63595d270d05 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.818799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4cb8-6807-4173-825a-63595d270d05 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.818799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4cb8-6807-4173-825a-63595d270d05 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.820218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 559/1135] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:59.826051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.826555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.826555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.846363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:59.847609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:59.919382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 577/1136] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:59.944393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4cb8-6807-4173-825a-63595d270d05 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:00.048660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:00.056869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4cb8-6807-4173-825a-63595d270d05 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:00.093231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:00.094030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:00.094305 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:00.094574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:00.095791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:00.097250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a73323-a8f6-43d5-a4e7-35dd2fcce771 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:00.098945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 560/1137] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:00.105315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:00.134751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:00.226092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b58c9-9a12-4898-8ae9-8cfa97adb5fb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:00.265237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:00.265916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:00.266199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:00.266470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:00.267218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:00.268721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8445-82a8-425c-bb02-ca7a31fbf009 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:00.290526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 578/1138] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:13:00 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:13:02.348426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0aab6-5040-4e18-86b5-9bf7dfd25751 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.349326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0aab6-5040-4e18-86b5-9bf7dfd25751 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.349326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0aab6-5040-4e18-86b5-9bf7dfd25751 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.351683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 561/1139] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:02.357204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502830-c994-4907-9a88-060b84947654 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.357644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502830-c994-4907-9a88-060b84947654 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.357733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502830-c994-4907-9a88-060b84947654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.377028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7a502830-c994-4907-9a88-060b84947654 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:02.378215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7a502830-c994-4907-9a88-060b84947654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:02.454176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 579/1140] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:02.478036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0aab6-5040-4e18-86b5-9bf7dfd25751 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.597699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0aab6-5040-4e18-86b5-9bf7dfd25751 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.634302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.635065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.635371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.635649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.646559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:02.654352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:02.655560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:02.656493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 562/1141] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:02.661976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502830-c994-4907-9a88-060b84947654 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.682431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.792077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502830-c994-4907-9a88-060b84947654 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.828656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.829334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.829613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.829888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.830635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:02.830940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:02.832363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:02.841145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 580/1142] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:02.851045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.886928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.966712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286bd2-f7fa-424f-b04f-32efff107266 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:03.015298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:03.016203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:03.016480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:03.016753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] PATH_INFO: `/v3/users/9b21d922079d4c3eb4724e91c7db5ad8` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:03.031722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] RBAC: Authorizing `identity:get_user(user_id=9b21d922079d4c3eb4724e91c7db5ad8)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:03.033194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:03.034863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 563/1143] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/users/9b21d922079d4c3eb4724e91c7db5ad8 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:03.041564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:03.122296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:03.150088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd6ec-6a38-437f-8b7c-b80b0f2c2b13 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:03.194759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:03.195696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:03.196065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:03.196428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:03.267323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:03.268815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:03.351426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:03.378538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 581/1144] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:03.385232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:03.483210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:03.508734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db8f57-0f56-4181-b038-54695b3aaa07 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:03.548195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:03.549066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:03.549348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:03.549632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] PATH_INFO: `/v3/projects/9be3dbb166634394a20d24c7916b7896` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:03.550928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] RBAC: Authorizing `identity:get_project(project_id=9be3dbb166634394a20d24c7916b7896)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:03.552392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64122b6-efa6-4966-98ff-c76e39fe2a3a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:03.554158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 564/1145] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:03 2022] GET /identity/v3/projects/9be3dbb166634394a20d24c7916b7896 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:03.560778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:03.666150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd80d1-35f6-48f9-889e-02eda7a8ca58 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:03.702346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:03.702976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:03.703256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:03.703565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:03.704392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=9be3dbb166634394a20d24c7916b7896, user.id=9b21d922079d4c3eb4724e91c7db5ad8) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:03.704703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:03.706144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130e7c-ece3-48cf-9565-f607d6bb36f0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:03.711783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 582/1146] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:03 2022] GET /identity/v3/role_assignments?user.id=9b21d922079d4c3eb4724e91c7db5ad8&scope.project.id=9be3dbb166634394a20d24c7916b7896&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:05.745695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef478-dc30-4748-ab60-f8fd97647bc0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.746269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef478-dc30-4748-ab60-f8fd97647bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.746269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef478-dc30-4748-ab60-f8fd97647bc0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.747678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 565/1147] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:05.754118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.754828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.755028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.779985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:05.781201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:05.813231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:05.862246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 583/1148] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:05.885533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ef478-dc30-4748-ab60-f8fd97647bc0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:06.009807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ef478-dc30-4748-ab60-f8fd97647bc0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:06.044836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:06.045986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:06.046260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:06.046525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:06.057113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:06.064789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:06.065932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:06.066975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:06.071274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 566/1149] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:06.072763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:06.188135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5b69-87ac-4078-bc96-a85bbde85fbb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:06.225482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:06.226141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:06.226415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:06.226678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:06.227448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:06.227749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:06.229206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:06.237528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 584/1150] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:06.246680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:06.259580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:06.369150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5af6-e5c9-4b6a-ac92-053e3798aa4e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:06.408076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:06.408958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:06.409234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:06.409488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] PATH_INFO: `/v3/users/9b21d922079d4c3eb4724e91c7db5ad8` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:06.410770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] RBAC: Authorizing `identity:get_user(user_id=9b21d922079d4c3eb4724e91c7db5ad8)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:06.412250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:06.413906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 567/1151] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:06 2022] GET /identity/v3/users/9b21d922079d4c3eb4724e91c7db5ad8 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:13:06.423721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:06.457193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:06.547148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6065c-4cdd-4536-8a9f-ac2b571fad62 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:06.591391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:06.594306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:06.594306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:06.594306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] PATH_INFO: `/v3/projects/9be3dbb166634394a20d24c7916b7896` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:06.594306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] RBAC: Authorizing `identity:get_project(project_id=9be3dbb166634394a20d24c7916b7896)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:06.595549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd584-2f3c-4ca8-bf43-75fcabf051c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:06.597301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 585/1152] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:06 2022] GET /identity/v3/projects/9be3dbb166634394a20d24c7916b7896 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:06.604726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:06.699552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:06.722987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cdf34-9a93-49da-8a7c-f364c7ce932b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:06.757972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:06.758867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:06.759142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:06.759484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] PATH_INFO: `/v3/projects/9be3dbb166634394a20d24c7916b7896/users/9b21d922079d4c3eb4724e91c7db5ad8/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:06.761630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be3dbb166634394a20d24c7916b7896, user_id=9b21d922079d4c3eb4724e91c7db5ad8, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:06.763092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbbc5-2c69-440e-9a7c-596baaef4b19 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:06.778781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 568/1153] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:13:06 2022] PUT /identity/v3/projects/9be3dbb166634394a20d24c7916b7896/users/9b21d922079d4c3eb4724e91c7db5ad8/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:13:08.787139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65677-b291-4b70-9eb3-c65f3c73d4c0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.787774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65677-b291-4b70-9eb3-c65f3c73d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.787774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65677-b291-4b70-9eb3-c65f3c73d4c0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.789119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 586/1154] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:08.795809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.796260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.796361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.818761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:08.819998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:08.894866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 569/1155] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:08.919123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65677-b291-4b70-9eb3-c65f3c73d4c0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.028344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:09.033672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65677-b291-4b70-9eb3-c65f3c73d4c0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.075620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.076418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.076707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.076983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.088309 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:09.096105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:09.097485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:13:09.099055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 587/1156] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:09.105300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.173404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:09.212550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8f87-2878-41d9-96bb-90ea6f554013 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.249044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.249716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.249993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.250266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.251023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:09.251338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:09.252751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:09.261902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 570/1157] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:09.268001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.373615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a77f-34b2-48d5-9c2b-30a2bcbe1a11 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.409125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.410006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.410285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.410562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] PATH_INFO: `/v3/users/9b21d922079d4c3eb4724e91c7db5ad8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.411833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9b21d922079d4c3eb4724e91c7db5ad8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:09.413303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:09.415000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 588/1158] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:09 2022] GET /identity/v3/users/9b21d922079d4c3eb4724e91c7db5ad8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:09.421460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.532057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0583c8-5e7f-4168-b20c-8aac66026895 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.559810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:09.568906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.569569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.569853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.570132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.640809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:09.642297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:09.750899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 571/1159] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:09.757117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.786198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:09.871026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ec4b-4a23-4492-a49f-5461cf5cc8c8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.906334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.907198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.907510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.907781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] PATH_INFO: `/v3/projects/9be3dbb166634394a20d24c7916b7896` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.908988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] RBAC: Authorizing `identity:get_project(project_id=9be3dbb166634394a20d24c7916b7896)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:09.910435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d7b4-9f0f-410b-809e-c1660af6c437 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:09.912219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 589/1160] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:09 2022] GET /identity/v3/projects/9be3dbb166634394a20d24c7916b7896 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:09.918903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:09.947620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:10.035490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83032f-8f42-4365-af85-8f14c372196e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:10.074938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:10.075948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:10.076416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:10.076869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:10.078363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=9be3dbb166634394a20d24c7916b7896, user.id=9b21d922079d4c3eb4724e91c7db5ad8) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:10.078794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:10.080352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bbd45-1dc9-4632-922b-88074c73760d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:10.086436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 572/1161] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:09 2022] GET /identity/v3/role_assignments?user.id=9b21d922079d4c3eb4724e91c7db5ad8&scope.project.id=9be3dbb166634394a20d24c7916b7896&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:13:12.649356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4bf7-5b00-4428-aa53-76dac491e37b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:12.649805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4bf7-5b00-4428-aa53-76dac491e37b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:12.649909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4bf7-5b00-4428-aa53-76dac491e37b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:12.651696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 590/1162] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:12.658251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:12.658730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:12.658832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:12.677094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:12.678327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:12.748229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 573/1163] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:12.771078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4bf7-5b00-4428-aa53-76dac491e37b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:12.872370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:12.882431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4bf7-5b00-4428-aa53-76dac491e37b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:12.917195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:12.917749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:12.918027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:12.918294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:12.988795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:12.990260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:13.080264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:13.088149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 591/1164] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:13.094406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:13.119735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:13.201825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f6da1-0210-4dba-9089-0d9fd17316fa None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:13.237428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:13.238236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:13.238520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:13.238787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:13.246823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:13.248346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1946ab88-103e-476f-b1a8-033113c5f308 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:13.265559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:13.266980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:13.267905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 574/1165] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:13:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:13.273361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:13.415269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29a5d-8830-4ebe-9e73-f27183596b6f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:13.449902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:13.450572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:13.450846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:13.451114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:13.451930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:13.452179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:13.453570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba432-062f-4d8a-b704-5e071a80c3d0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:13.461234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 592/1166] 10.222.0.82 () {56 vars in 1115 bytes} [Wed Jul 20 19:13:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:15.506520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dedf-1eea-4358-b3cf-e418f2e25754 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:15.507097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dedf-1eea-4358-b3cf-e418f2e25754 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:15.507097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dedf-1eea-4358-b3cf-e418f2e25754 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:15.508478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 575/1167] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:15.514141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec50c-bcc4-4288-85df-c75d61bf7fb7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:15.514613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec50c-bcc4-4288-85df-c75d61bf7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:15.514715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec50c-bcc4-4288-85df-c75d61bf7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:15.532622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3a4ec50c-bcc4-4288-85df-c75d61bf7fb7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:15.533511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3a4ec50c-bcc4-4288-85df-c75d61bf7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:15.588712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:15.604178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 593/1168] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:15.627456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305dedf-1eea-4358-b3cf-e418f2e25754 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:15.718451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:15.741076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305dedf-1eea-4358-b3cf-e418f2e25754 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:15.778048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:15.778637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:15.778913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:15.779189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:15.779969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:15.781362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad406d-0eef-4f07-b6b0-7aa709aac666 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:15.797817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 576/1169] 10.222.0.82 () {60 vars in 1138 bytes} [Wed Jul 20 19:13:15 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:13:17.836405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceeb86-7711-4963-afe9-f0568e2b7534 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:17.837009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceeb86-7711-4963-afe9-f0568e2b7534 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:17.837009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceeb86-7711-4963-afe9-f0568e2b7534 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:17.838402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 594/1170] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:17.844856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e687-679f-437a-b160-92d297872e90 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:17.845610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e687-679f-437a-b160-92d297872e90 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:17.845887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e687-679f-437a-b160-92d297872e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:17.871871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-de50e687-679f-437a-b160-92d297872e90 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:17.873103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-de50e687-679f-437a-b160-92d297872e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:17.956954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 577/1171] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:17.988807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceeb86-7711-4963-afe9-f0568e2b7534 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:18.107452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceeb86-7711-4963-afe9-f0568e2b7534 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:18.143008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:18.143910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:18.144188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:18.144466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] PATH_INFO: `/v3/domains/f88e85065b964309831fba280ab11a7f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:18.155598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f88e85065b964309831fba280ab11a7f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:18.157061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9532f34-ba41-4905-8254-830c21135714 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:18.158748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 595/1172] 10.222.0.82 () {56 vars in 1183 bytes} [Wed Jul 20 19:13:17 2022] GET /identity/v3/domains/f88e85065b964309831fba280ab11a7f => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:18.167678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e687-679f-437a-b160-92d297872e90 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:18.241768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:18.286936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e687-679f-437a-b160-92d297872e90 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:18.323343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:18.324011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:18.324285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:18.324552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:18.325243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:18.326693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db64b-3146-4b12-9bb0-8b24b394ffb4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:18.358893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 578/1173] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:13:18 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:13:20.422197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf98e-df6a-40d8-8a13-1fce6af917de None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:20.422808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf98e-df6a-40d8-8a13-1fce6af917de None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:20.422808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf98e-df6a-40d8-8a13-1fce6af917de None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:20.424822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 596/1174] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:20.432523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:20.432947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:20.433102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:20.452777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:20.453986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:20.537621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 579/1175] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:20.563943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedf98e-df6a-40d8-8a13-1fce6af917de None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:20.621671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:20.684666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedf98e-df6a-40d8-8a13-1fce6af917de None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:20.718667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:20.719551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:20.719836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:20.720106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] PATH_INFO: `/v3/domains/f88e85065b964309831fba280ab11a7f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:20.721311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f88e85065b964309831fba280ab11a7f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:20.722769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55baa22-1710-4983-8fee-bacc0ac4c443 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:20.724471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 597/1176] 10.222.0.82 () {56 vars in 1183 bytes} [Wed Jul 20 19:13:20 2022] GET /identity/v3/domains/f88e85065b964309831fba280ab11a7f => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:20.731589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:20.787763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:20.835909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf9e5c-c351-42d8-b6bf-230c8951c691 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:20.875842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:20.876493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:20.876804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:20.877080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:20.877796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:20.879271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65604036-df43-430a-a0f1-113ed2300963 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:20.907335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 580/1177] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:13:20 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:13:22.975954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aff1d-8703-40f2-a82f-e9c382712ec4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:22.976523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aff1d-8703-40f2-a82f-e9c382712ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:22.976523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aff1d-8703-40f2-a82f-e9c382712ec4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:22.977889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 598/1178] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:22.988400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:22.988926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:22.989496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:23.014093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:23.015300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:23.086233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 581/1179] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:23.110011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aff1d-8703-40f2-a82f-e9c382712ec4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:23.219205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aff1d-8703-40f2-a82f-e9c382712ec4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:23.236633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:23.256145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:23.256963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:23.257245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:23.257520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:23.268596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:23.276545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:23.277750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:13:23.278670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 599/1180] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:23.284212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:23.328159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:23.389940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c110-db0b-4703-821a-66fd2c7b79d2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:23.425653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:23.426334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:23.426615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:23.426882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:23.427668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:23.427971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:23.429366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:23.438586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 582/1181] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:23.445201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:23.569755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793882-6adc-418a-8b18-bc95758fed4a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:23.605591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:23.606463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:23.606741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:23.607015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] PATH_INFO: `/v3/users/ed314a95c46f4982a3389d384dae329f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:23.623502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed314a95c46f4982a3389d384dae329f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:23.624956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:23.626679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 600/1182] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:23 2022] GET /identity/v3/users/ed314a95c46f4982a3389d384dae329f => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:23.636518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:23.750224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3a321-21e3-49f0-b916-b38fbc9d5dde None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:23.751874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:23.787949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:23.788610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:23.788922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:23.789195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:23.861588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:23.862974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:23.972982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 583/1183] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:23.979606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:24.020054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:24.094441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac954b56-d0fd-4a3e-8739-e9b9473bdfc8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:24.133290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:24.134124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:24.134414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:24.134692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] PATH_INFO: `/v3/projects/b59f90e62fc248cf9e99f608fd30dbde` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:24.135940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] RBAC: Authorizing `identity:get_project(project_id=b59f90e62fc248cf9e99f608fd30dbde)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:24.137407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5db4d3-d76d-45c4-a62a-116dbeb3db12 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:24.139265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 601/1184] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:23 2022] GET /identity/v3/projects/b59f90e62fc248cf9e99f608fd30dbde => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:24.145779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:24.148024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:24.255368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5a5d3-b916-40f8-882b-a741bfd5e203 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:24.300259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:24.300908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:24.301196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:24.301471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:24.302330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=b59f90e62fc248cf9e99f608fd30dbde, user.id=ed314a95c46f4982a3389d384dae329f) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:24.302642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:24.304128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620f8b-644e-4836-86d7-0db6f77f5859 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:24.310561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 584/1185] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:24 2022] GET /identity/v3/role_assignments?user.id=ed314a95c46f4982a3389d384dae329f&scope.project.id=b59f90e62fc248cf9e99f608fd30dbde&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:26.336144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418162-3f03-4d42-ac25-d3cd2fbe0203 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:26.336725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418162-3f03-4d42-ac25-d3cd2fbe0203 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:26.336725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418162-3f03-4d42-ac25-d3cd2fbe0203 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:26.338135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 602/1186] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:26.344599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:26.345320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:26.345456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:26.366568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:26.367808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:26.433267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:26.443169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 585/1187] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:26.467750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11418162-3f03-4d42-ac25-d3cd2fbe0203 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:26.588210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11418162-3f03-4d42-ac25-d3cd2fbe0203 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:26.589803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:26.626417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:26.627221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:26.627528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:26.627806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:26.638387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:26.646166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:26.647392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:13:26.648959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 603/1188] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:26.653925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:26.757811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb8d1-cbc5-4ff3-b137-ebbde777b080 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:26.794102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:26.795164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:26.795482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:26.795755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:26.796543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:26.796847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:26.798286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:26.807896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 586/1189] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:26.815154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:26.927117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39193c8a-4c8b-4323-9c68-4f8c68def586 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:26.963320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:26.964330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:26.964606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:26.964872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] PATH_INFO: `/v3/users/ed314a95c46f4982a3389d384dae329f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:26.966093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ed314a95c46f4982a3389d384dae329f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:26.967573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:26.969242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 604/1190] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:26 2022] GET /identity/v3/users/ed314a95c46f4982a3389d384dae329f => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:26.975432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:27.041244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:27.086542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d277-eaa2-4ed9-b919-277f84ff1227 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:27.121836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:27.122703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:27.122976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:27.123241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] PATH_INFO: `/v3/projects/b59f90e62fc248cf9e99f608fd30dbde` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:27.124589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] RBAC: Authorizing `identity:get_project(project_id=b59f90e62fc248cf9e99f608fd30dbde)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:27.126033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b9dc-fb6f-4774-a4f8-b4f8d146b766 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:27.127834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 587/1191] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:26 2022] GET /identity/v3/projects/b59f90e62fc248cf9e99f608fd30dbde => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:27.134385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:27.166717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:27.239777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335818-b92d-443d-900c-3ad50633d3c4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:27.276643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:27.277549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:27.277832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:27.278104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] PATH_INFO: `/v3/projects/b59f90e62fc248cf9e99f608fd30dbde/users/ed314a95c46f4982a3389d384dae329f/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:27.280262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59f90e62fc248cf9e99f608fd30dbde, user_id=ed314a95c46f4982a3389d384dae329f, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:27.281733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63cef-a9ae-4e3e-87c4-4c6dd93c4824 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:27.297451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 605/1192] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:13:27 2022] PUT /identity/v3/projects/b59f90e62fc248cf9e99f608fd30dbde/users/ed314a95c46f4982a3389d384dae329f/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:13:29.316570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3423d-06ed-4b31-a704-c08873487c94 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:29.317130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3423d-06ed-4b31-a704-c08873487c94 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:29.317130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3423d-06ed-4b31-a704-c08873487c94 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:29.318496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 588/1193] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:29.324847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:29.325384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:29.325384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:29.346174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:29.347992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:29.434601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 606/1194] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:29.459059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3423d-06ed-4b31-a704-c08873487c94 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:29.564850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3423d-06ed-4b31-a704-c08873487c94 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:29.590501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:29.599887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:29.600679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:29.600950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:29.601214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:29.615273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:29.622951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:29.624141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:13:29.625208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 589/1195] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:29.630616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:29.661149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:29.759879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7721-a3d6-4fe5-814d-00c08863a910 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:29.799163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:29.799863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:29.800154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:29.800418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:29.801168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:29.801473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:29.802894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:29.812083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 607/1196] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:29.818610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:29.927400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f1e3-ebc7-4e80-a8aa-62ca7fadd171 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:29.962985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:29.963887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:29.964162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:29.964425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] PATH_INFO: `/v3/users/ed314a95c46f4982a3389d384dae329f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:29.965635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] RBAC: Authorizing `identity:get_user(user_id=ed314a95c46f4982a3389d384dae329f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:29.967095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:29.968799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 590/1197] 10.222.0.82 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:29 2022] GET /identity/v3/users/ed314a95c46f4982a3389d384dae329f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:29.975003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:30.078156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:30.097656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117cc7-fb66-43a2-980b-5950e8fcecaa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:30.136227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:30.136867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:30.137146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:30.137415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:30.207153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:30.208632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:30.299866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:30.329838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 608/1198] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:30.336336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:30.397743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:30.448508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c64cc4-0afa-47b9-b4fb-953683aa088a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:30.486172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:30.486936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:30.487211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:30.487507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] PATH_INFO: `/v3/projects/b59f90e62fc248cf9e99f608fd30dbde` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:30.488727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] RBAC: Authorizing `identity:get_project(project_id=b59f90e62fc248cf9e99f608fd30dbde)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:30.490174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0add-1287-4526-a44a-820a950b967b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:30.491916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 591/1199] 10.222.0.82 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:30 2022] GET /identity/v3/projects/b59f90e62fc248cf9e99f608fd30dbde => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:30.498508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:30.601785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ccab-684e-4daf-bdd5-2f6874bf81cb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:30.639167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:30.639873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:30.640156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:30.640428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:30.641256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=b59f90e62fc248cf9e99f608fd30dbde, user.id=ed314a95c46f4982a3389d384dae329f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:30.641570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:30.643019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090818-9f06-405c-a0ce-c8956c7865b6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:30.649558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 609/1200] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:30 2022] GET /identity/v3/role_assignments?user.id=ed314a95c46f4982a3389d384dae329f&scope.project.id=b59f90e62fc248cf9e99f608fd30dbde&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:40.480703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=39 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:40.646692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=77 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:26.952705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19184-47c1-4970-972d-0a64c80d9313 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.953369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19184-47c1-4970-972d-0a64c80d9313 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.953369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19184-47c1-4970-972d-0a64c80d9313 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.955003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 592/1201] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:26.960981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.961871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.961871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.981655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:26.982870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:27.085024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 610/1202] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:27.111709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19184-47c1-4970-972d-0a64c80d9313 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:27.274063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc19184-47c1-4970-972d-0a64c80d9313 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:27.333463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:27.334670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:27.337664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:27.338389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:27.363839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:27.365557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:27.386962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:27.388064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:27.389040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:27.389040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:27.389040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:27.389040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:27.391519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 593/1203] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:27.398283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:27.577774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7081a-6d0e-4bc7-b3da-906cdaba1de2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:27.630480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:27.643570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:27.644341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:27.644634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:27.644916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:27.645719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:27.650369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:27.651700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cf285-4515-44d2-85b1-de4d14d54d4b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:27.673285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 611/1204] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:27.674770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:27.770941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:27.859978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e336d2-4336-4c39-8eab-e5049106efbe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:27.907854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:27.909057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:27.909571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:27.910029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:27.911411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:27.914166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19f60d-8bdb-4767-918b-3d152d77440e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:27.951326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 594/1205] 10.222.0.82 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:27 2022] POST /identity/v3/users => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:30.328458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894f73-1c3a-4841-8ad0-39e56fc62634 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.329047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894f73-1c3a-4841-8ad0-39e56fc62634 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.329047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894f73-1c3a-4841-8ad0-39e56fc62634 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.330621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 612/1206] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:30.337271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.338298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.338298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.361994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:30.363500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:30.465688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 595/1207] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:30.491768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8894f73-1c3a-4841-8ad0-39e56fc62634 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.614010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8894f73-1c3a-4841-8ad0-39e56fc62634 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.662575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.663144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.663458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.663746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.677275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:30.685769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:30.687171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:30.688103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 613/1208] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:30.695844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.747955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.836482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1b60-e053-4c74-8aa9-e337abe7195d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.879341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.879943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.880223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.880501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.881255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:30.881567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.882987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.900503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 596/1209] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:30.902536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.965955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.043723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe100d-9d5c-49f8-b4a8-207458d1711b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.083941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.084807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.085085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.085354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.100297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.101982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:31.123333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:31.124871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:31.126085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:31.126085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:31.126085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:31.126085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:31.127532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 614/1210] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:31.132018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.283550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.287346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d300d5-61e9-4aaf-8a08-1093938792ad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.335208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.335969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.336247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.336498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.337370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:31.338037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.339507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.354308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 597/1211] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.360970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.488431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16fb22-a8c8-4937-8c0d-bf65975d5387 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.490269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.535203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.536402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.536889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.537622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.550880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.554240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:31.577396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:31.578594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:31.579743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:31.580423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 615/1212] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:31.588558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.755056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0a576-7bbf-40d9-866f-e43704e04e4a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.811978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.813219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.813636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.814082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.815569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:31.816205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.818439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.850660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 598/1213] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.859713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.019584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a650c-33a9-46ba-9924-ed1e27797c79 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.069519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.070264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.070600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.070968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.115555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.169187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.170898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.329314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 616/1214] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:32.332495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.354395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.466122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6c6e-70cd-403a-9933-32c5574c1e44 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.511249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.512073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.512384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.512655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.527824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.529802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:32.552434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:32.553548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:32.559679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:32.559679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:32.559679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:32.559679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:32.559679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 599/1215] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:32.559986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.643422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.713564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963a8f-03fb-49b0-aa37-439e5724675e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.767416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.768169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.768455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.768730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.769464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:32.769768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.771231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.786812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 617/1216] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.792930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.924169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.978705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de62a-f3cd-42fe-861a-05fd46041b41 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.021258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.022564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.022944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.023542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.036027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.038932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:33.061849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:33.063022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:33.063976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:33.064464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 600/1217] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:33.070663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.210295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5efd15-1d41-452d-9a54-80c44d4fb841 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.241277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.259587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.260662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.261166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.261633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.262783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:33.263421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.265650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55106-0363-4877-a88b-d161234d9a7d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.289117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 618/1218] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:33.296682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.438462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa9a8-e85b-4bdd-9528-fa555d2904ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.482645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.489925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.490648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.490927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.491204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.492060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=a77e20517c584bc0bd7df627d805467b) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:33.492404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.493933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ec6fb-df65-44cf-9978-46db62a6bf1e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.511697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 601/1219] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/role_assignments?user.id=a77e20517c584bc0bd7df627d805467b&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:35.689059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efbf12-3fa9-4469-9720-76b1fbb5e642 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.689618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efbf12-3fa9-4469-9720-76b1fbb5e642 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.689618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efbf12-3fa9-4469-9720-76b1fbb5e642 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.691006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 619/1220] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:35.697263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.697808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.697808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.716123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:35.717340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:35.793857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 602/1221] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:14:35.819037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efbf12-3fa9-4469-9720-76b1fbb5e642 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:35.968794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efbf12-3fa9-4469-9720-76b1fbb5e642 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.024038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.025507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.026011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.026457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.046590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:36.054439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.056031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:36.056911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 620/1222] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:36.062722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.180437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44374-41e5-42d0-b664-2ead4f06d5ed None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.217738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.231573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.232168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.232442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.232710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.233463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.233792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.235172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.244318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 603/1223] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.251041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.318717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.425407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9c77-ae35-4807-adb1-0cf7a05b50b6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.493719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.494801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.495141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.495671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.513510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.515245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:36.535519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.536874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.537891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:36.537891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:36.537891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:36.537891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:36.537891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 621/1224] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:36.547028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.675452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9e09-e50e-4640-bd48-eb6c6b719459 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.715833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.716620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.716883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.717174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.718001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.718333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.720016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.739227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 604/1225] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.744943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.865035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.875286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb70d5-b31c-4587-b7ee-80ce58d98869 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.921926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.922888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.923261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.923636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.932429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.933951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:36.949867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.951090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:36.952095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 622/1226] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:36.958292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.011853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.074568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003871-5b82-4dc6-a772-0f21a5becfb9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.115064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.115768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.116052 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.116321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.117161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:37.117461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.118994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.138695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 605/1227] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:37.145111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.270011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547a52-9c58-42f6-b980-71bc04df80af None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.325228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.326098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.326373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.326639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.341523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.343910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:37.364852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:37.365958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:37.367072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:37.367072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:37.367072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:37.367072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:37.367072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 623/1228] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:37.373313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.496727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737efe8c-e2bb-4155-9e1e-c712ce683904 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.499645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.534991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.535602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.535880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.536153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.536894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:37.537198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.538615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.553920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 606/1229] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:37.560156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.571650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.681588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f196-af0b-4499-b1ee-7c4b35513631 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.726435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.727260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.727621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.727904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.736023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.737654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:37.752785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:37.754322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:37.755564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 624/1230] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:37.760489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.882707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b66f9-2c1a-459b-ac8b-106cffecc393 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.922681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.923422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.923710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.924060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.924908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:37.925293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.926940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e40a-6d37-4940-81d7-62107fb9306d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.942193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 607/1231] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:37.949319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.029441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.072077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a276-89a6-4a52-beb1-d9fffd4d75df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.111719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.112626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.112912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.113191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/a77e20517c584bc0bd7df627d805467b/roles/d5d490f52b8c4cbf8e5667b0c85f5baa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.131450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=a77e20517c584bc0bd7df627d805467b, role_id=d5d490f52b8c4cbf8e5667b0c85f5baa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.133068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557405e8-2c78-4a13-b8c0-af604f063ec2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.148420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 625/1232] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:37 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/a77e20517c584bc0bd7df627d805467b/roles/d5d490f52b8c4cbf8e5667b0c85f5baa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:40.511174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6be2-d1c7-457c-90e4-4845a214a316 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.511973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6be2-d1c7-457c-90e4-4845a214a316 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.511973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6be2-d1c7-457c-90e4-4845a214a316 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.513515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 608/1233] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:40.523051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.523627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.523627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.544908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:40.546134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:40.667434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 626/1234] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:40.691480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6be2-d1c7-457c-90e4-4845a214a316 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.726662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.823618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6be2-d1c7-457c-90e4-4845a214a316 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.874045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.875545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.875882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.876202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.894654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:40.904514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:40.906216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:40.907491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 609/1235] 10.222.0.82 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:40.912119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.996824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.087701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeae656-6603-4b5f-b79b-3ec92b388090 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.136875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.137585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.137867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.138148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.138918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.139235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.140728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.150838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 627/1236] 10.222.0.82 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.159096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.324497 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.357627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5122-a2ad-443f-8bc3-f46a9b153a8c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.413729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.414551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.414828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.415137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.429868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.431969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:41.450833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:41.452199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:41.453261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:41.453261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:41.453261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:41.453261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:41.453261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 610/1237] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:41.459477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.645278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a1f-a3ba-43eb-8d1c-be2750062a9f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.664930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.712487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.713661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.714139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.714635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.716001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.716543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.719195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.735885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 628/1238] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.742437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.904189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721a49b-c89d-4962-933d-d7e12a7c0f31 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.947039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.947910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.948267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.948539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.952232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.960310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.962809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:41.981117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:41.982895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:41.984240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 611/1239] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:41.989531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.119811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebff686-28d5-4450-8ca5-ce00f59aec13 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.165459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.166090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.166421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.166832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.167731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:42.168426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.170072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.193297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 629/1240] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:42.199846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.349180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867838f2-f228-447d-a1ed-44f7a0d48a00 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.404827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.405844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.406293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.406748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.497794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.515413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.518223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.668837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 612/1241] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:14:42.675944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.709725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.815921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b42d90-7d43-41e4-9a48-179d0a93d3bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.867818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.868925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.869387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.869781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.884450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.886043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:42.906737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:42.907881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:42.908808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:42.908808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:42.908808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:42.908808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:42.913158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 630/1242] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:42.914901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.049358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.060822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce052e8-5624-439b-b9c3-1742dcd66223 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.111467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.112634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.113177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.113642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.115037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:43.115635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.118294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.142002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 613/1243] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:43.143404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.251146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.291859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac55bba-f154-417f-9933-1f2f51086764 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.337256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.339198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.339717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.340249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.354612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.356478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:43.373617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:43.374910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:43.375894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 631/1244] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:43.384082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.531530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d7bd3-7366-4044-90a5-3e2496f0396f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.592554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.593673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.594159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.594616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.596106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:43.596604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.598609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113438a8-6812-4311-82ec-cc0884f40935 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.618987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 614/1245] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:43.626018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.753681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197a471-74d9-4ede-98a9-c43046bf4926 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.798349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.799070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.799374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.799763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.800753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] RBAC: Adding query filter params (role.id=d5d490f52b8c4cbf8e5667b0c85f5baa, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=a77e20517c584bc0bd7df627d805467b) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:43.801118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.802672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcd09-6275-4ee0-9f72-9a0094764bba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.810379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 632/1246] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/role_assignments?user.id=a77e20517c584bc0bd7df627d805467b&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=d5d490f52b8c4cbf8e5667b0c85f5baa => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:46.244086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32fa7-3d1b-4efa-8d90-a5a7764cfc4e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.244735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32fa7-3d1b-4efa-8d90-a5a7764cfc4e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.244735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32fa7-3d1b-4efa-8d90-a5a7764cfc4e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.247747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 615/1247] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:46.254011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.254697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.254697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.260089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.282462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:46.284959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:46.415403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 633/1248] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:14:46.439135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf32fa7-3d1b-4efa-8d90-a5a7764cfc4e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.470374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.595058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf32fa7-3d1b-4efa-8d90-a5a7764cfc4e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.639097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.640025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.640316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.640595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.653652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:46.661621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:46.663030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:46.664769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 616/1249] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:46.670328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.805862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd455751-3e20-4790-b2a8-79e4902be74f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.843070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.850551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.851267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.851553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.851827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.852738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:46.853063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.854583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.864754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 634/1250] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:46.871096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.974452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.009833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750011-cfe6-4c69-83e3-63c6a3b44bd6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.054172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.055250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.055677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.055951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.068886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.070379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:47.091185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:47.092259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:47.093179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:47.093179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:47.093179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:47.093179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:47.093179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 617/1251] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:47.099540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.229688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922dae4-f871-4dd1-8148-04d51d82bc5c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.274237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.275058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.275164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.275451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.276315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:47.276619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.278042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.294314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 635/1252] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:47.300861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.424664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d57d7-533f-46ad-bb8b-dfc688d02f5a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.461083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.471840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.472722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.472996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.473260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.481615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.482946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:47.499134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:47.505328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:47.506517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 618/1253] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:47.507204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.572218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.631908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa6763-d68a-4332-af9c-2de41a0561bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.679561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.680385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.680702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.680977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.682021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:47.682308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.683921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.704336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 636/1254] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:47.710573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.837270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd53e0-ed3d-4c7e-a5a4-78bbf0c1706f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.873124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.873669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.873953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.874228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.943567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.962429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.964200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.088986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 619/1255] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:48.090535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.219339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c4dde-45af-4831-beee-a67389bdfa6f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.237821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.279334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.279334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.279334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.279334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.296251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.298016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:48.319393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:48.320588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:48.321835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:48.321835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:48.321835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:48.321835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:48.321835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 637/1256] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:48.327450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.438887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.453291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d8d01-3c8e-4129-8aa7-43f221d81029 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.493918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.494702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.494954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.495436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.495992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:48.496363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.498113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.516181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 620/1257] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:48.518902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.642202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b13a1-cbad-4dff-9691-293d1849966c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.686512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.687350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.687624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.687893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.695742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.697305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:48.712107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:48.713273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:48.714285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 638/1258] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:48.720065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.851073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85216574-7923-4693-a6f1-a2fb4f190cbe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.899182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.900102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.900420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.900704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.901600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:48.901940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.903520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0ee7c-df4b-4d81-9f67-c9d86ce282e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.919248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 621/1259] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:48.926435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.954919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:49.050616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb3f6-6edd-41a2-af9e-762bb7687315 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:49.093224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:49.094000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.094356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.094669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.095594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=a77e20517c584bc0bd7df627d805467b) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:49.095880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.097351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea44ec1-9444-41c2-80c3-2ecdafc5c3b4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.104200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 639/1260] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/role_assignments?user.id=a77e20517c584bc0bd7df627d805467b&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:51.250771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ddab-eae4-4f8f-82a6-1d7f5f6b823c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.251714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ddab-eae4-4f8f-82a6-1d7f5f6b823c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.251714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ddab-eae4-4f8f-82a6-1d7f5f6b823c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.253955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 622/1261] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:51.262203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.262749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.262749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.285115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:51.286854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:51.361448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 640/1262] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:51.384507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5ddab-eae4-4f8f-82a6-1d7f5f6b823c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.397248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.495918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5ddab-eae4-4f8f-82a6-1d7f5f6b823c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.530937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.531672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.531983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.532254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.543593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:51.551231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:51.552357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:51.553249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 623/1263] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:51.572603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.597329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.686942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b63b-9c0f-413e-bcb3-d108504570da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.728118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.728789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.729069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.729372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.730132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:51.730435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.731919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.743712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 641/1264] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:51.751441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.829320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.866005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb236f0-729a-497b-b2bf-f77741320783 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.902328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.903136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.903449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.903726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.916045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.917567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:51.936840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:51.937910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:51.939053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:51.939053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:51.939053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:51.939053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:51.939053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 624/1265] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:51.945001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.035607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:52.056906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7efc-11e2-4f94-97f6-d6545978ade5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.094523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.095109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.095424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.095703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.096437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:52.096746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.098234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.113441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 642/1266] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:52.119553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.229928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0585c9a-4a28-4a5c-86e0-46d83acf80fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.250078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:52.265367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.266178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.266455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.266713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.274498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.275977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:52.291700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:52.297366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:52.298635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 625/1267] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:52.302253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.423602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d3c-db1d-4d35-abc7-f42f96782de9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.463925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.464574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.464880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.465154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.466003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:52.466324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.467821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.476949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:52.486013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 643/1268] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:52.494904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.606606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ba8e-8ee2-4a5c-b798-246021f79402 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.650930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.651801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.652082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.652355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.664448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.665940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:52.684920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:52.686064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:52.687142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:52.687142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:52.687142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:52.687142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:52.687142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 626/1269] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:52.693813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.811945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924305-7f9b-4786-8846-6dcf91ad9ca5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.851675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.852330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.852605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.852878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.853598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:52.853898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.855280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.868013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 644/1270] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:52.877195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.918320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.004174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925bf4-4860-4dcb-b6d6-6d01fbb57f5b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.044238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69febb-8287-4bdf-affe-095634072433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.045065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69febb-8287-4bdf-affe-095634072433 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.045313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69febb-8287-4bdf-affe-095634072433 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.045598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69febb-8287-4bdf-affe-095634072433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.052496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69febb-8287-4bdf-affe-095634072433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:53.053950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69febb-8287-4bdf-affe-095634072433 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-be69febb-8287-4bdf-affe-095634072433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:53.068705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:53.069776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:53.071178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 627/1271] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:53.076207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.137838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.188048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d997356-e008-4cd4-a8fc-6913fb890642 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.224902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.225548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.225831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.226105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.226923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:53.227298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:53.228799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6936f0-7aa6-47bf-9f40-511c004b1352 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:53.241664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 645/1272] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:53.248226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69febb-8287-4bdf-affe-095634072433 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.363001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.373102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69febb-8287-4bdf-affe-095634072433 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.408558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.409454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.409726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.409977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] PATH_INFO: `/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/a77e20517c584bc0bd7df627d805467b/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.412151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] RBAC: Authorizing `identity:create_grant(project_id=69d0399f14a24c259888e0c8df1f3fdf, user_id=a77e20517c584bc0bd7df627d805467b, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:53.413607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96828f96-0f39-4700-a9b9-62990da5d22d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:53.430110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 628/1273] 10.222.0.82 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:53 2022] PUT /identity/v3/projects/69d0399f14a24c259888e0c8df1f3fdf/users/a77e20517c584bc0bd7df627d805467b/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:14:55.496936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb78-3340-4242-88f0-590a0553faf3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.497543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb78-3340-4242-88f0-590a0553faf3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.497543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb78-3340-4242-88f0-590a0553faf3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.498864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 646/1274] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:55.504953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.505465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.505589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.527121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:55.528372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:55.604206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 629/1275] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:55.628487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb78-3340-4242-88f0-590a0553faf3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.743863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb78-3340-4242-88f0-590a0553faf3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.763332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.783027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.783870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.784152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.784426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.797636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:55.805387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:55.806706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:55.807870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 647/1276] 10.222.0.82 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:55.813097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.902850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.923586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67c72-2c69-469f-a193-d812d4ebfd86 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.962244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.962930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.963209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.963512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.964282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:55.964587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.966005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.985003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 630/1277] 10.222.0.82 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:55.991391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.113594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3078-a303-46ba-8e37-fc23366ab21d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.155717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.156613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.156945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.157259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.170253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.171786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:56.191186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:56.193077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:56.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:56.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:56.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:56.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:56.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 648/1278] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:56.200004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.326914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cdaf6-79be-4dd1-aec6-ca01885a3a58 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.379779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.380572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.381024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.381301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.382638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:56.382990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.385256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:56.398940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 631/1279] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:56.405515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.439944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:56.515191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce458e-d5e0-4bc7-99de-f1b5aa1b55e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.551768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.552588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.552864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.553132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.562096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.563608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:56.578881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:56.580048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:14:56.581026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 649/1280] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:56.589567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.594021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:56.699219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09ac5-5274-49c2-96dc-ba8212d3e0d1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.734346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.735025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.735298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.735597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.736426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:56.736730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.738263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:56.757316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 632/1281] 10.222.0.82 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:56.768808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.870829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:56.882137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d9a3-38d6-4507-83fc-2dcfbc88b19d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.917391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.918317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.918596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.918874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.992134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.993706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.090258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.101252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 650/1282] 10.222.0.82 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:57.108317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.183815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.225033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3643cc-6bb2-4913-bcce-7d5e09059e4d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.259599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.260405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.260677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.260941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.273064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.275164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:57.305561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:57.307276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:57.309601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:57.309601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:57.309601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:57.309601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:57.309601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 633/1283] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:57.316928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.422346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc898c-07ed-4b03-9987-b1f75840419e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.460706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.461367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.461698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.461959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.462679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:57.462993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.464495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.477055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 651/1284] 10.222.0.82 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:57.483060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.592029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53bffe-c10d-4e75-a7b1-b995289ab36d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.612287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.638288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.639096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.639391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.639667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.647040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.648574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:57.663021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:57.664283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jul 20 19:14:57.665354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 634/1285] 10.222.0.82 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:57.671460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.737812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.792673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810067-a363-4d89-8b58-7133c7cd8585 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.839658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.840307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.840614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.840868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.841642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:57.841972 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.843459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc121f-5f3f-4efb-8ef0-0ee77b4ad60f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.855796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 652/1286] 10.222.0.82 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:57.862106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.971923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b047-e86f-4848-b6a5-df6028dfc05d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:58.014053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:58.014615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:58.014894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:58.015162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:58.016023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] RBAC: Adding query filter params (role.id=c3b9dae1beda4ff3b7b79942b90621e0, scope.project.id=69d0399f14a24c259888e0c8df1f3fdf, user.id=a77e20517c584bc0bd7df627d805467b) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:58.016333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:58.017775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cac924-41f5-4e88-94cb-1dff289799b5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:58.026837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 635/1287] 10.222.0.82 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/role_assignments?user.id=a77e20517c584bc0bd7df627d805467b&scope.project.id=69d0399f14a24c259888e0c8df1f3fdf&role.id=c3b9dae1beda4ff3b7b79942b90621e0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:00.110921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf88d-cffb-49bb-afce-654a83cf97a8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.111517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf88d-cffb-49bb-afce-654a83cf97a8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.111517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf88d-cffb-49bb-afce-654a83cf97a8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.112924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 653/1288] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:00.119045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.119482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.119621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.142441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:00.143704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:00.180708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.223969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 636/1289] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:00.247775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccf88d-cffb-49bb-afce-654a83cf97a8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.368495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccf88d-cffb-49bb-afce-654a83cf97a8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.380419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.406321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.407136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.407442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.407842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.408808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.409753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:00.423373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:00.424555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:00.425608 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 654/1290] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:00.433774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.559552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ab00-934c-4801-8e06-7389c00ae0ae None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.594677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.595347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.595634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.595902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.596607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:00.596899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.598303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc3d3-3e17-48dd-94e4-d506e7521962 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.604229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 637/1291] 10.222.0.82 () {56 vars in 1116 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:00.610378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.724409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14663-392d-42ad-bf78-9894c5ec2c8d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.760995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.761661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.761946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.762219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.762930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:00.763226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.764677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e9d2-fd85-4219-b4ce-f4fef765ec94 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.770096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 655/1292] 10.222.0.82 () {56 vars in 1116 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:02.803377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe35d4-a544-4a87-8377-aa4cb568cb92 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.804228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe35d4-a544-4a87-8377-aa4cb568cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.804228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe35d4-a544-4a87-8377-aa4cb568cb92 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.806416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 638/1293] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:02.811612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505c32-fa8d-4388-9220-e8d655f1c3af None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.812036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505c32-fa8d-4388-9220-e8d655f1c3af None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.812126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505c32-fa8d-4388-9220-e8d655f1c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.830120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-95505c32-fa8d-4388-9220-e8d655f1c3af None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:02.831294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-95505c32-fa8d-4388-9220-e8d655f1c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:02.866710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.912334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 656/1294] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:02.946464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe35d4-a544-4a87-8377-aa4cb568cb92 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.988461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.069560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe35d4-a544-4a87-8377-aa4cb568cb92 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.108672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.109362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.109640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.109915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.110645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.112067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267568cd-2290-4ea5-bfcc-2bd2b65ab270 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.127954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 639/1295] 10.222.0.82 () {60 vars in 1141 bytes} [Wed Jul 20 19:15:02 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:05.192009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e74db-250a-4207-b522-0d0346e2572a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.192605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e74db-250a-4207-b522-0d0346e2572a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.192605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e74db-250a-4207-b522-0d0346e2572a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.193970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 657/1296] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:05.199405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.199839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.199953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.218967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:05.220229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:05.308359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 640/1297] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:05.331686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e74db-250a-4207-b522-0d0346e2572a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.449054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e74db-250a-4207-b522-0d0346e2572a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.484651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.485476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.485764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.486030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.486682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.488087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:05.500366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:05.501540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:05.502638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 658/1298] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:05.513073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.536996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.624930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e311-2c3d-42fd-bf46-3a76d16ab46d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.661800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.662464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.662744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.663011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.663754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:05.664055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.665448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.671798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 641/1299] 10.222.0.82 () {56 vars in 1116 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:05.678660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.718909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.794461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b934b-7466-49d4-8251-2f68709b3905 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.831643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.832298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.832576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.832846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.833635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] RBAC: Adding query filter params (interface=public, service_id=6e7bf39e4e324161a514ede26f2ba86d, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:05.833944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.835346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af104ed8-107e-4c2c-8acf-c7ed970e705e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.840492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 659/1300] 10.222.0.82 () {56 vars in 1251 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/endpoints?service_id=6e7bf39e4e324161a514ede26f2ba86d&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:05.846327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.932273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.952665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872637-a713-4b00-ae4c-f586c13fd9fd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.987982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.988567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.988842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.989111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.989782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.991166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6fa92-b4cb-455f-96d6-cce3ef8dec73 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.998210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 642/1301] 10.222.0.82 () {56 vars in 1087 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:15:08.012073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cc12-8af6-41cd-9659-61c44525a813 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.012978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cc12-8af6-41cd-9659-61c44525a813 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.012978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cc12-8af6-41cd-9659-61c44525a813 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.015113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 660/1302] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:08.020620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.021041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.021130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.039937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:08.041165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:08.110481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 643/1303] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:08.134224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818cc12-8af6-41cd-9659-61c44525a813 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.241762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.249859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818cc12-8af6-41cd-9659-61c44525a813 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.285119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.285850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.286121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.286388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.287040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.288480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:08.301251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:08.302438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jul 20 19:15:08.303332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 661/1304] 10.222.0.82 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:08.309472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.387488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.413067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c6a4d-c7bd-4faf-9729-313dd14e8c5c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.446979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.447668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.447955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.448224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.448926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:08.449230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.450625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d778be-5b57-4dd1-86c5-93a4685781c5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.456245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 644/1305] 10.222.0.82 () {56 vars in 1116 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:08.462638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.567223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454ff5-6a65-434b-8e60-dc875a494ca5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.602767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.603508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.603795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.604072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.604818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.606250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14c1d-28f7-4f82-9d64-ad8bc5e4d638 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.626409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 662/1306] 10.222.0.82 () {60 vars in 1144 bytes} [Wed Jul 20 19:15:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:18.452895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=30 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:18.623876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.572510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b2a0-812d-40bd-b252-a6031029e2c9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.573075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b2a0-812d-40bd-b252-a6031029e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.573075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b2a0-812d-40bd-b252-a6031029e2c9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.578621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 645/1307] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:14.580066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174bb3-d995-4f66-b834-5205eba38d47 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.580542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174bb3-d995-4f66-b834-5205eba38d47 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.580638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174bb3-d995-4f66-b834-5205eba38d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.671388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-46174bb3-d995-4f66-b834-5205eba38d47 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:14.672728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46174bb3-d995-4f66-b834-5205eba38d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:14.831384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 663/1308] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:16:14.880338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.881097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.881616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.883638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 646/1309] 10.222.0.82 () {54 vars in 965 bytes} [Wed Jul 20 19:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:14.889479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759a72-5cc7-45f3-a1ec-257119f5ca71 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.889765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759a72-5cc7-45f3-a1ec-257119f5ca71 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.890034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759a72-5cc7-45f3-a1ec-257119f5ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.978577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a1759a72-5cc7-45f3-a1ec-257119f5ca71 None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:14.979942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a1759a72-5cc7-45f3-a1ec-257119f5ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:15.002143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.071462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.073178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:15.077693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 664/1310] 10.222.0.82 () {58 vars in 1062 bytes} [Wed Jul 20 19:16:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:15.210393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ec6a-3d5a-48ee-8a2e-c926e2864fe7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.304102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.304778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.305074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.305438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.307183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:15.370958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.438889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.440438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed62888-8c20-4ed2-aab1-30301b348ae7 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.464002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 647/1311] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:16:17.835640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea7f7-1860-47fd-b3f6-e3b4b98a70d6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.836513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea7f7-1860-47fd-b3f6-e3b4b98a70d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.836513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea7f7-1860-47fd-b3f6-e3b4b98a70d6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.838695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 665/1312] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:17.844985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834105-4413-4304-984f-ac1df9ecb11e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.845460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834105-4413-4304-984f-ac1df9ecb11e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.845556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834105-4413-4304-984f-ac1df9ecb11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.936010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d3834105-4413-4304-984f-ac1df9ecb11e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:17.937638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d3834105-4413-4304-984f-ac1df9ecb11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:18.042009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 648/1313] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:18.099065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.099521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.099893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.101363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 666/1314] 10.222.0.82 () {54 vars in 965 bytes} [Wed Jul 20 19:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:18.113520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1f1c-e967-4259-8f3a-cb2818c489ef None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.113520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1f1c-e967-4259-8f3a-cb2818c489ef None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.113520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1f1c-e967-4259-8f3a-cb2818c489ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.119631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:18.194580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d18f1f1c-e967-4259-8f3a-cb2818c489ef None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:18.196021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d18f1f1c-e967-4259-8f3a-cb2818c489ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:18.285463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 649/1315] 10.222.0.82 () {58 vars in 1062 bytes} [Wed Jul 20 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:18.295213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:18.296801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:18.408921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307005-c51a-49ab-be15-332827cf1f43 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:18.496165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:18.498961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:18.499661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.499943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.500225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.503703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:18.634212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:18.635722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7fd2e-cd25-4b3f-92ab-4df881526d62 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:18.655455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 667/1316] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:21.259179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.259767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.259767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.261154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 650/1317] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:21.268070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed29a-8033-44e2-94f4-644deb04c027 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.268568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed29a-8033-44e2-94f4-644deb04c027 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.268867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed29a-8033-44e2-94f4-644deb04c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.380351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9feed29a-8033-44e2-94f4-644deb04c027 None None] MFA Rules not processed for user `ccc514bd462946f1bf3425c214f1d782`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:21.381595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9feed29a-8033-44e2-94f4-644deb04c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.440745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.490192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 668/1318] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:21.536483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.538053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.654604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6cbf6-a85a-43f8-bc84-9fdd96e7fa0b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.657563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.734851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.735528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.735803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.736066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.737725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.863352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.864756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586fdeb-6aae-429c-b41d-c39e3262a74d service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:21.884404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 651/1319] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:24.721819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:24.722487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:24.722487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:24.723841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 669/1320] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:24.730442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4e642-0b6c-47a9-8116-5def148f7a04 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:24.730915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4e642-0b6c-47a9-8116-5def148f7a04 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:24.731033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4e642-0b6c-47a9-8116-5def148f7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:24.789464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:24.822937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9fa4e642-0b6c-47a9-8116-5def148f7a04 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:24.824304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9fa4e642-0b6c-47a9-8116-5def148f7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:24.953384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 652/1321] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:24.993929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:24.995546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.107426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20a9f6-229b-4f12-a137-5f839a24416f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:25.202609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:25.203272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.203649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.203859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.205574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.214130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.344769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:25.346253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc17c7-5ab1-4e9f-9b3d-ef931a3de46b service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:25.368459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 670/1322] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:28.194377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.194933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.194933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.196359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 653/1323] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:28.201839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3918-cba3-4a73-b6fd-e05a5a50bf0f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.202328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3918-cba3-4a73-b6fd-e05a5a50bf0f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.202422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3918-cba3-4a73-b6fd-e05a5a50bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.277085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-746f3918-cba3-4a73-b6fd-e05a5a50bf0f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:28.278319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-746f3918-cba3-4a73-b6fd-e05a5a50bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:28.343099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.384967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 671/1324] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:28.422954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.424602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:28.546597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bbb77-ec0f-48ec-88a7-ab80f5cece0f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:28.559836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.628165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:28.628739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.629043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.629347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.631018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:28.749966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:28.751469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7da0-e2b6-4b6a-9c7c-e377f31e65a0 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:28.770507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 654/1325] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:30.893021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.893887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.893887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.896266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 672/1326] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:30.902402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a7d-7696-43d4-8c83-d95e0e3277db None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.902875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a7d-7696-43d4-8c83-d95e0e3277db None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.902875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1a7d-7696-43d4-8c83-d95e0e3277db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.952645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:30.972318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a9af1a7d-7696-43d4-8c83-d95e0e3277db None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:30.973554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a9af1a7d-7696-43d4-8c83-d95e0e3277db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:31.086579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 655/1327] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:31.124600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.126443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:31.242946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb490a-2d13-441d-bca8-f6f568e8855d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.325050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.325715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.325993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.326287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.328060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:31.348240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.452432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.453940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a640b-1eb1-45bd-b0c0-9c80ff90e988 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.473994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 673/1328] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:33.586981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:33.587635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:33.587635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:33.589037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 656/1329] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:33.594886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29419c-2c76-4f2d-95c9-31368774de5e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:33.595401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29419c-2c76-4f2d-95c9-31368774de5e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:33.595625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29419c-2c76-4f2d-95c9-31368774de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:33.671045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bb29419c-2c76-4f2d-95c9-31368774de5e None None] MFA Rules not processed for user `ccc514bd462946f1bf3425c214f1d782`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:33.672300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bb29419c-2c76-4f2d-95c9-31368774de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:33.764860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:33.808776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 674/1330] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:33.849387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:33.851242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:33.982595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92f21-a1d3-4f73-909f-99f5673d497d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:34.008621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:34.081675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:34.082538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.082890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.083233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.085255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:34.215745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:34.217229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cad6-4116-4b77-9e62-44335dedd50d service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:34.256740 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 657/1331] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:36.612127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:36.613042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:36.613218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:36.615753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 675/1332] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:36.624134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f5f1-12f0-45bc-9365-87f2f534c61a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:36.624661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f5f1-12f0-45bc-9365-87f2f534c61a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:36.624661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f5f1-12f0-45bc-9365-87f2f534c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:36.702362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:36.705916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a177f5f1-12f0-45bc-9365-87f2f534c61a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:36.707216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a177f5f1-12f0-45bc-9365-87f2f534c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:36.820111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 658/1333] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:36.858461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:36.861025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:36.990554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaff0e7-f579-438a-adaa-971d1a70501b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:37.074392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:37.075047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:37.075355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:37.075653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:37.077367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:37.106440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:37.193444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:37.194902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a523a9-2840-4281-a978-53bdaf0ced76 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:37.213148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 676/1334] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:39.325158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:39.325732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:39.325732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:39.327164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 659/1335] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:39.332903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634d2e-90b1-46fb-9542-45982d6ddae5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:39.333397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634d2e-90b1-46fb-9542-45982d6ddae5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:39.333488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634d2e-90b1-46fb-9542-45982d6ddae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:39.404277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-46634d2e-90b1-46fb-9542-45982d6ddae5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:39.405501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46634d2e-90b1-46fb-9542-45982d6ddae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:39.483620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:39.507667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 677/1336] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:39.547511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:39.549081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:39.658386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1c8f4-0969-42d3-b0ad-2056fe497c3f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:39.690147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:39.741846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:39.742504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:39.742781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:39.743049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:39.744775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:39.861570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:39.863034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3749d2-1746-4d4e-ac2b-f2c9572d88bd service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:39.881663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 660/1337] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:42.354389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:42.354973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:42.355067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:42.356452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 678/1338] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:42.362516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed943-e5e0-4f8f-9143-0b65cf12fe56 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:42.363010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed943-e5e0-4f8f-9143-0b65cf12fe56 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:42.363102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed943-e5e0-4f8f-9143-0b65cf12fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:42.433823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5caed943-e5e0-4f8f-9143-0b65cf12fe56 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:42.435092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5caed943-e5e0-4f8f-9143-0b65cf12fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:42.443909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:42.541851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 661/1339] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:42.579136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:42.580727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:42.694286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a670-454f-47c9-b5f0-ea517a87fc1f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:42.771504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:42.772162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:42.772444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:42.772720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:42.774392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:42.820057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:42.899378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:42.900744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce16dc-14b0-4e87-a5a8-4e30dfea14a4 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:42.919872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 679/1340] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:47.146211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:47.147109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:47.147109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:47.149709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 662/1341] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:47.156507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4b76b-26f4-48b8-8d4a-7b316e15aa06 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:47.157367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4b76b-26f4-48b8-8d4a-7b316e15aa06 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:47.157367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4b76b-26f4-48b8-8d4a-7b316e15aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:47.243602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c5c4b76b-26f4-48b8-8d4a-7b316e15aa06 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:47.245542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c5c4b76b-26f4-48b8-8d4a-7b316e15aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:47.344397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:47.358526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 680/1342] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:47.399210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:47.400802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:47.516545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a77ad4-e3a7-45f3-8cec-d278599b5933 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:47.560093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:47.604251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:47.605006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:47.605288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:47.605695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:47.607513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:47.747091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:47.748602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efaa5e-669e-4688-a5bf-23dba1d6277a service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:47.769765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 663/1343] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:50.618278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:50.618857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:50.618857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:50.620693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 681/1344] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:50.626815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080862c-72ed-4096-8a43-3434b6ff1291 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:50.627524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080862c-72ed-4096-8a43-3434b6ff1291 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:50.627524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080862c-72ed-4096-8a43-3434b6ff1291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:50.706077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f080862c-72ed-4096-8a43-3434b6ff1291 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:50.707363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f080862c-72ed-4096-8a43-3434b6ff1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:50.732692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:50.822122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 664/1345] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:50.859462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:50.861011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:50.972524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832cc71-6b5e-4c48-8e5a-35cd6eb24dfd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:51.054948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:51.055560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.055840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.056172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.057863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:51.103770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:51.175334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:51.176854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa47d-100c-4db2-ac5c-5e7b9439313b service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:51.198035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 682/1346] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:55.596302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.596896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.596896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.598231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 665/1347] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:55.605775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae6e20-7457-4a85-a7f5-ebc8eec9a021 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.606394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae6e20-7457-4a85-a7f5-ebc8eec9a021 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.606635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae6e20-7457-4a85-a7f5-ebc8eec9a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.685751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f5ae6e20-7457-4a85-a7f5-ebc8eec9a021 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:55.687294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5ae6e20-7457-4a85-a7f5-ebc8eec9a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:55.795485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.799241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 683/1348] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:55.838237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:55.840186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:55.955826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6d915-70f1-48f2-9eae-a4f1be96dc9c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:56.006453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:56.040590 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:56.041622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:56.041911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:56.042182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:56.043958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:56.172104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:56.173533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145d1c-9d8f-44e0-963c-3deb7c4c8f1c service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:56.192679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 666/1349] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:01.228740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bdef-9d02-4378-9875-d12917bb8076 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.229318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bdef-9d02-4378-9875-d12917bb8076 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.229318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bdef-9d02-4378-9875-d12917bb8076 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.231243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 684/1350] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:01.236801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c50b-3a4c-465a-9e6f-74a74294282a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.237205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c50b-3a4c-465a-9e6f-74a74294282a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.237377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c50b-3a4c-465a-9e6f-74a74294282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.361333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-75f9c50b-3a4c-465a-9e6f-74a74294282a None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:01.362570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-75f9c50b-3a4c-465a-9e6f-74a74294282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:01.432146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.554928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 667/1351] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:17:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:05.846761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ccda-c350-4533-b138-507374166b4e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:05.847769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ccda-c350-4533-b138-507374166b4e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:05.848255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ccda-c350-4533-b138-507374166b4e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:05.850538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 685/1352] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:05.856241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a4d17-ef6d-4208-9c8f-82589ec47fee None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:05.856758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a4d17-ef6d-4208-9c8f-82589ec47fee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:05.856841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a4d17-ef6d-4208-9c8f-82589ec47fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:05.941843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d87a4d17-ef6d-4208-9c8f-82589ec47fee None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:05.943110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d87a4d17-ef6d-4208-9c8f-82589ec47fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:06.028473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:06.084255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 668/1353] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:17:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:07.705056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6b1d-c49c-4774-ba36-9e8d24d5daf3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:07.705831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6b1d-c49c-4774-ba36-9e8d24d5daf3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:07.705969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6b1d-c49c-4774-ba36-9e8d24d5daf3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:07.708330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 686/1354] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:07.716047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368edd41-4e40-4653-a03f-71c6e9eca557 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:07.716868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368edd41-4e40-4653-a03f-71c6e9eca557 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:07.717044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368edd41-4e40-4653-a03f-71c6e9eca557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:07.825600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-368edd41-4e40-4653-a03f-71c6e9eca557 None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:07.826835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-368edd41-4e40-4653-a03f-71c6e9eca557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:07.960219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 669/1355] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:11.842161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c886df-99e0-4ccb-92a5-1d954894d6ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.842161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c886df-99e0-4ccb-92a5-1d954894d6ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.842161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c886df-99e0-4ccb-92a5-1d954894d6ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.844014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 687/1356] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:11.849799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e9a1-40af-4ecb-9078-e65e60646251 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.850380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e9a1-40af-4ecb-9078-e65e60646251 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.850380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e9a1-40af-4ecb-9078-e65e60646251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.922376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:11.969416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9518e9a1-40af-4ecb-9078-e65e60646251 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:11.971017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9518e9a1-40af-4ecb-9078-e65e60646251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.108111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 670/1357] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:12.177691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.178172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.178934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.181629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 688/1358] 10.222.0.82 () {54 vars in 962 bytes} [Wed Jul 20 19:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:12.191679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b04fc-847e-4a25-8ad7-83a40e19dd42 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.191964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b04fc-847e-4a25-8ad7-83a40e19dd42 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.192422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b04fc-847e-4a25-8ad7-83a40e19dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.301099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a45b04fc-847e-4a25-8ad7-83a40e19dd42 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:12.302768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a45b04fc-847e-4a25-8ad7-83a40e19dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.369694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.498882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 671/1359] 10.222.0.82 () {58 vars in 1059 bytes} [Wed Jul 20 19:17:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:12.511421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:12.513015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.714096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded01d9-a719-44f1-bbbb-22fafc3eb34c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:12.859024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.906321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:12.906889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.907176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.907483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.909203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:13.015909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:13.019053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faf1e0-e533-4b9b-bef2-cddce5b89203 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:13.053221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 689/1360] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:17:15.334506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.335093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.335093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.336710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 672/1361] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:15.342043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7080e-bfeb-4855-a791-1065ea586f6e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.342552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7080e-bfeb-4855-a791-1065ea586f6e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.342552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7080e-bfeb-4855-a791-1065ea586f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.418180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9be7080e-bfeb-4855-a791-1065ea586f6e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:15.419399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9be7080e-bfeb-4855-a791-1065ea586f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:15.460028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.547271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 690/1362] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:15.586042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:15.587639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:15.766793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524daa14-5bc2-404b-8e3c-2eda243cb9fb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:15.778453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.904102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:15.904658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.904945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.905202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.906844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:16.004281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:16.005914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148f7e3-296d-4157-b442-fbebe3df8088 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:16.027268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 673/1363] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:18.476719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021356bc-ffb2-4dd1-9e17-032a3487e94a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.478088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021356bc-ffb2-4dd1-9e17-032a3487e94a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.478575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021356bc-ffb2-4dd1-9e17-032a3487e94a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.480624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 691/1364] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:18.486792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb21159-79a0-4938-962f-a4ecaf94a052 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.486792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb21159-79a0-4938-962f-a4ecaf94a052 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.486792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb21159-79a0-4938-962f-a4ecaf94a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.504262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.569463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3bb21159-79a0-4938-962f-a4ecaf94a052 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:18.571088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3bb21159-79a0-4938-962f-a4ecaf94a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:18.697052 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 674/1365] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:18.744635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.744937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.745416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.747190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 692/1366] 10.222.0.82 () {54 vars in 962 bytes} [Wed Jul 20 19:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:18.753049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1207485-7f5b-4558-bba3-9282fac5f79f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.753571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1207485-7f5b-4558-bba3-9282fac5f79f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.753830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1207485-7f5b-4558-bba3-9282fac5f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.842357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c1207485-7f5b-4558-bba3-9282fac5f79f None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:18.843712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c1207485-7f5b-4558-bba3-9282fac5f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:18.886330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.978486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 675/1367] 10.222.0.82 () {58 vars in 1059 bytes} [Wed Jul 20 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:18.986461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:18.987912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:19.142834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7adc5-d1eb-4d49-9d82-c9a02a32191b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:19.164984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:19.267125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:19.267728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:19.268026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:19.268323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:19.269968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:19.376598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:19.378225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087dc1-1c38-44a1-8d50-30a44673df98 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:19.399750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 693/1368] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:20.241381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6291b5c-0b99-41bb-a8f6-b7338007ae23 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.241979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6291b5c-0b99-41bb-a8f6-b7338007ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.241979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6291b5c-0b99-41bb-a8f6-b7338007ae23 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.247291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 676/1369] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:20.250300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bfc45-10e6-4775-b7b3-c0d2840da00c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.250300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bfc45-10e6-4775-b7b3-c0d2840da00c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.250300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bfc45-10e6-4775-b7b3-c0d2840da00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.284384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:20.325104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ad9bfc45-10e6-4775-b7b3-c0d2840da00c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:20.326354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad9bfc45-10e6-4775-b7b3-c0d2840da00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:20.434600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 694/1370] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:20.800744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.800744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.800744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.802923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 677/1371] 10.222.0.82 () {54 vars in 964 bytes} [Wed Jul 20 19:17:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:20.808320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ceea-709e-4b5a-aee8-9f9de548daa2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.808611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ceea-709e-4b5a-aee8-9f9de548daa2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.809178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ceea-709e-4b5a-aee8-9f9de548daa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.901767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ead3ceea-709e-4b5a-aee8-9f9de548daa2 None None] MFA Rules not processed for user `4bacfdb698cf41dfb6be9a0e94daf371`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:20.903544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ead3ceea-709e-4b5a-aee8-9f9de548daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:20.969352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.011549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 695/1372] 10.222.0.82 () {58 vars in 1061 bytes} [Wed Jul 20 19:17:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:21.016876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.018578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:21.140748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b44ab3-4018-41d6-8528-90d00d4a2adb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:21.185500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.222460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:21.223264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.223658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.224086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.225856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:21.364727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:21.366150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5be13-6425-4d78-a472-aaad8e48231d service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:21.389809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 678/1373] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:21.582205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.582766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.582766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.585460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 696/1374] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:21.589599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631885-681c-436c-8e5b-157e7deeb2f3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.590027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631885-681c-436c-8e5b-157e7deeb2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.590420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631885-681c-436c-8e5b-157e7deeb2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.680019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-24631885-681c-436c-8e5b-157e7deeb2f3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:21.681744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-24631885-681c-436c-8e5b-157e7deeb2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:21.711168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.810733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 679/1375] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:21.858722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.860369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:22.014692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099ff1-a6fa-4045-8543-8d66acf845a6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:22.081424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:22.163845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:22.164543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:22.164826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:22.165225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:22.167394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:22.265831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:22.267516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b744faa-e974-43ee-98e9-d99b0e71bfcc service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:22.286400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 697/1376] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:24.425120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833029b-97a1-4276-9872-269283b66c9b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:24.425624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833029b-97a1-4276-9872-269283b66c9b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:24.426081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833029b-97a1-4276-9872-269283b66c9b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:24.428187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 680/1377] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:24.434739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056d0e-48a1-49c7-9645-966728dbf524 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:24.435162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056d0e-48a1-49c7-9645-966728dbf524 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:24.435653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056d0e-48a1-49c7-9645-966728dbf524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:24.512182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-10056d0e-48a1-49c7-9645-966728dbf524 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:24.513446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-10056d0e-48a1-49c7-9645-966728dbf524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:24.534943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:24.637571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 698/1378] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:24.682420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833029b-97a1-4276-9872-269283b66c9b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:24.683973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9833029b-97a1-4276-9872-269283b66c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:24.846296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833029b-97a1-4276-9872-269283b66c9b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:24.850293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:25.004392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:25.005076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:25.005387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:25.005608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:25.007345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:25.148838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:25.150406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a149b79-85f7-40e7-beb7-f0517313dea1 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:25.178823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 681/1379] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:27.300591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:27.301714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:27.302201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:27.304067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 699/1380] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:27.311398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de444a-ac05-4e91-964d-965b43cf611e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:27.312446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de444a-ac05-4e91-964d-965b43cf611e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:27.313045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de444a-ac05-4e91-964d-965b43cf611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:27.326183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:27.420831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a5de444a-ac05-4e91-964d-965b43cf611e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:27.423043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a5de444a-ac05-4e91-964d-965b43cf611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:27.533213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 682/1381] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:27.579369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:27.581038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:27.772467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:27.780457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d20a1-0970-486f-900f-3c32c099aee9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:27.910417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:27.911011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:27.911291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:27.911606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:27.913492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:28.017960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:28.019616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be911e8e-5fca-4371-9091-5eab4f74d88b service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:28.031459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:28.041422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 700/1382] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:30.198375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:30.199041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:30.199196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:30.201329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 683/1383] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:30.207700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9334b-0e9a-4294-bc3c-73c5e2694e79 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:30.208160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9334b-0e9a-4294-bc3c-73c5e2694e79 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:30.208408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9334b-0e9a-4294-bc3c-73c5e2694e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:30.289809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-29b9334b-0e9a-4294-bc3c-73c5e2694e79 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:30.291436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-29b9334b-0e9a-4294-bc3c-73c5e2694e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:30.403564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 701/1384] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:30.450562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:30.452808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:30.570584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:30.654749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb2c8-f9d6-4847-b460-41eba7f86a1a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:30.800670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:30.801418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:30.801739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:30.802037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:30.803926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:30.873160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:30.924014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:30.926184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80560b9-bac4-43a8-82f9-c2b6e8c4ea9c service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:30.950147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 684/1385] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:33.205402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:33.206001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:33.206001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:33.207712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 702/1386] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:17:33.214661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98717-3cec-4a0b-a625-5fbb6478616c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:33.215299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98717-3cec-4a0b-a625-5fbb6478616c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:33.215299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98717-3cec-4a0b-a625-5fbb6478616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:33.316709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9de98717-3cec-4a0b-a625-5fbb6478616c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:33.318705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9de98717-3cec-4a0b-a625-5fbb6478616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:33.437928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 685/1387] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:33.487010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:33.488702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:33.571766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:33.648965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57055ea5-a4a0-4114-b9e3-fdd463fb1dac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:33.797713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:33.798338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:33.798625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:33.798897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:33.800672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:33.846729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:33.914447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:33.917225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e100af-f50c-4820-b269-850a5f7fddb4 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:33.936873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 703/1388] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:36.015144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.015788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.015788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.017157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 686/1389] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:36.022622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518584e9-0e99-46a8-a899-55b571d83061 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.023187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518584e9-0e99-46a8-a899-55b571d83061 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.023187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518584e9-0e99-46a8-a899-55b571d83061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.092329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-518584e9-0e99-46a8-a899-55b571d83061 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:36.093569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-518584e9-0e99-46a8-a899-55b571d83061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:36.193567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 704/1390] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:36.238946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:36.240546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:36.280014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:36.406738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a15e1-68e6-4355-8582-d6e6a4ef137d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:36.519721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:36.533858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:36.534449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.534718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.534997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.536691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:36.639589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:36.641218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddff97-7d84-4875-b092-f4d78f295403 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:36.658904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247742-8b64-4ea3-93f7-8de609cbd28f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.659194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247742-8b64-4ea3-93f7-8de609cbd28f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.659519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247742-8b64-4ea3-93f7-8de609cbd28f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.660276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 687/1391] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:36.660928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 705/1392] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:36.668819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797491a1-a088-489f-ac81-4ed0984f524d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.668819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797491a1-a088-489f-ac81-4ed0984f524d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.669042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797491a1-a088-489f-ac81-4ed0984f524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.739786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-797491a1-a088-489f-ac81-4ed0984f524d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:36.741095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-797491a1-a088-489f-ac81-4ed0984f524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:36.813403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:36.859831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 688/1393] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:36.917433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.917842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.918234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:36.919914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 706/1394] 10.222.0.82 () {54 vars in 966 bytes} [Wed Jul 20 19:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:36.925487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2c54-1287-4682-9d36-adb885d04400 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:36.925748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2c54-1287-4682-9d36-adb885d04400 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:36.926018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2c54-1287-4682-9d36-adb885d04400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:37.004784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b4bc2c54-1287-4682-9d36-adb885d04400 None None] MFA Rules not processed for user `6c159e59080a41d2b1857c89c6e4c442`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:37.006036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b4bc2c54-1287-4682-9d36-adb885d04400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:37.089426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 689/1395] 10.222.0.82 () {58 vars in 1063 bytes} [Wed Jul 20 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:37.097277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:37.098795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:37.114798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:37.217247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32c87-e559-42ac-b137-fd782ca85b86 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:37.293056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:37.293716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:37.293994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:37.294258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:37.295937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:37.370243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:37.414523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:37.416426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea85f1-b529-4947-a2ff-fe2e26291c6c service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:37.435141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 707/1396] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:38.172776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9b49-f073-4904-8cf7-751fd9c8eaea None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.173267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9b49-f073-4904-8cf7-751fd9c8eaea None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.173359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9b49-f073-4904-8cf7-751fd9c8eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.241808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f57f9b49-f073-4904-8cf7-751fd9c8eaea None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:38.243047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f57f9b49-f073-4904-8cf7-751fd9c8eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.252713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:38.340989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 690/1397] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:38.389850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.390406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.390619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.392409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 708/1398] 10.222.0.82 () {54 vars in 943 bytes} [Wed Jul 20 19:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:38.399196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53209d-ee21-4a86-882f-ac4e3135e996 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.399586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53209d-ee21-4a86-882f-ac4e3135e996 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.399878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53209d-ee21-4a86-882f-ac4e3135e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.476224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0d53209d-ee21-4a86-882f-ac4e3135e996 None None] MFA Rules not processed for user `8731b43dcbb644a9abde1b4b30f5911e`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:38.477440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0d53209d-ee21-4a86-882f-ac4e3135e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.580986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:38.610276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 691/1399] 10.222.0.82 () {58 vars in 1040 bytes} [Wed Jul 20 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:38.623619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:38.625807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.749082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf70b7-b91c-4897-aa7a-51ad23196c39 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.749298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf70b7-b91c-4897-aa7a-51ad23196c39 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.749545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf70b7-b91c-4897-aa7a-51ad23196c39 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.751096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 692/1400] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:17:38.756377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.756810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.757087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.791763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f38ea-3a49-4259-9ba0-9d15b0faf88b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:38.831722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:38.832937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.834688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:38.911458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:38.912121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.912403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.912676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.914478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.937937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 693/1401] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:38.983041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:38.984330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.999621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:39.001183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668106c-a976-4591-bb5a-2d30a1aa5d6f service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:39.009948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 709/1402] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:17:39.062815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:39.123789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c771b3-d416-4c44-9a68-6069e9ef612f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:39.275567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:39.276222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:39.276416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:39.276773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:39.278497 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:39.350986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:39.388606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:39.390413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae908-71d9-4bcf-9297-4f72a9581ec9 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:39.411172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 694/1403] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:41.507569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:41.510140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:41.510444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:41.512121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 710/1404] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:41.518337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d75a2-5ef1-491f-a5fb-39edef80870d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:41.518900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d75a2-5ef1-491f-a5fb-39edef80870d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:41.518900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d75a2-5ef1-491f-a5fb-39edef80870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:41.601018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ba8d75a2-5ef1-491f-a5fb-39edef80870d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:41.602038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ba8d75a2-5ef1-491f-a5fb-39edef80870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:41.717557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 695/1405] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:41.766524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:41.768599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:41.909467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:42.004768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e62ab-69c4-42d1-8b6d-0f31a9c880e9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:42.160498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:42.161621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:42.161901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:42.162869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:42.164859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:42.201198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:42.276205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:42.282428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bedee-0eb0-4605-a37c-8d8724f19cb2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:42.303773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 711/1406] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:44.430315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:44.431074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:44.431074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:44.432609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 696/1407] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:44.438618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b5c8-a98a-467a-bfeb-52e71ba66048 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:44.439942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b5c8-a98a-467a-bfeb-52e71ba66048 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:44.439942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b5c8-a98a-467a-bfeb-52e71ba66048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:44.515771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aef6b5c8-a98a-467a-bfeb-52e71ba66048 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:44.517312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aef6b5c8-a98a-467a-bfeb-52e71ba66048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:44.692300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 712/1408] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:44.738495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:44.740487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:44.784063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:44.916071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed0984-eb65-44c2-9ff3-6730f9c383fa None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:45.040977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:45.047096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:45.048011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:45.048394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:45.048744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:45.050435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:45.159523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:45.161205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf8715-4db9-4dfd-9851-b359b1485f27 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:45.185487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 697/1409] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:54.690558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:55.182855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=47 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:01.479724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19e66-a868-4e99-bdb6-89978008df05 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.480766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19e66-a868-4e99-bdb6-89978008df05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.480766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19e66-a868-4e99-bdb6-89978008df05 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.481862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 713/1410] 10.222.0.82 () {54 vars in 918 bytes} [Wed Jul 20 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:01.488172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2824f-db47-4ad3-9775-f0968e2a77be None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.488741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2824f-db47-4ad3-9775-f0968e2a77be None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.488838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2824f-db47-4ad3-9775-f0968e2a77be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.573660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-abf2824f-db47-4ad3-9775-f0968e2a77be None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:01.575025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-abf2824f-db47-4ad3-9775-f0968e2a77be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:01.700475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 698/1411] 10.222.0.82 () {58 vars in 1015 bytes} [Wed Jul 20 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:01.718250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b36-f92f-49b4-b5ed-a9d529f427a2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.718534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b36-f92f-49b4-b5ed-a9d529f427a2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.718808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b36-f92f-49b4-b5ed-a9d529f427a2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.720291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 714/1412] 10.222.0.82 () {54 vars in 918 bytes} [Wed Jul 20 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:01.725767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527657d-caf3-4640-abd5-8e41634a8d6a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.726100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527657d-caf3-4640-abd5-8e41634a8d6a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.726387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527657d-caf3-4640-abd5-8e41634a8d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.811619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:01.816669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f527657d-caf3-4640-abd5-8e41634a8d6a None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:01.818675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f527657d-caf3-4640-abd5-8e41634a8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:01.961149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 699/1413] 10.222.0.82 () {58 vars in 1015 bytes} [Wed Jul 20 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:04.540948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:04.541804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:04.541804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:04.543737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:04.549666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b86d2-52e2-4887-bc64-981a6096fbe1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:04.550178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b86d2-52e2-4887-bc64-981a6096fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:04.550178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b86d2-52e2-4887-bc64-981a6096fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:04.620619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-237b86d2-52e2-4887-bc64-981a6096fbe1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:04.621932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-237b86d2-52e2-4887-bc64-981a6096fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:04.680883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:04.728096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:04.775554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:04.777419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:04.953393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dd5ae-629c-41ef-b890-392171091b2e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:05.038144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:05.086844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:05.087559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:05.087937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:05.088299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:05.090161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:05.195068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:05.196778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656621d-98b7-4e41-98bb-f641632252e7 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:05.216135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 716/1416] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:06.195785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.196396 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.196645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.199254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:06.205498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d00811-9f5d-408d-ab53-d73df1fd9c41 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.206021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d00811-9f5d-408d-ab53-d73df1fd9c41 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.206021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d00811-9f5d-408d-ab53-d73df1fd9c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.296257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-73d00811-9f5d-408d-ab53-d73df1fd9c41 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:06.297484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73d00811-9f5d-408d-ab53-d73df1fd9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:06.328707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:06.414222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:06.566739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:06.568441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:06.740139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d02cc-e5bf-454c-9ef0-1ad5e3c40322 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:06.787680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:06.876221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:06.876909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.877186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.877458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.879196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:06.984144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:06.985819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651cb6-d684-4d2d-a9bd-2a50b78ace39 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:07.007288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 702/1419] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:18:07.958546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:07.959225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:07.959225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:07.960577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:07.966694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f529-3ae5-4d15-a133-714ede7eb284 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:07.967238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f529-3ae5-4d15-a133-714ede7eb284 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:07.967582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f529-3ae5-4d15-a133-714ede7eb284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:08.031059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:08.058239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2a21f529-3ae5-4d15-a133-714ede7eb284 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:08.059533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2a21f529-3ae5-4d15-a133-714ede7eb284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:08.172710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:08.324578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:08.326058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:08.509452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f21d-6ce6-4a93-834a-2d451f59ad11 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:08.522731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:08.644410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:08.644991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:08.645283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:08.645564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:08.647246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:08.747988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:08.749641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be3de-88e8-446b-b35b-faa61ba4e93b service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:08.769821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 719/1422] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:18:09.663240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:09.663838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:09.664080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:09.665760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:09.671794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040807c-ae1e-485e-bf6e-cff2b03122c8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:09.672389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040807c-ae1e-485e-bf6e-cff2b03122c8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:09.672389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040807c-ae1e-485e-bf6e-cff2b03122c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:09.692206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:09.760420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c040807c-ae1e-485e-bf6e-cff2b03122c8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:09.761747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c040807c-ae1e-485e-bf6e-cff2b03122c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:09.868501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:10.018473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:10.020122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:10.155489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:10.203420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf52d-f9b9-428d-aa44-1efcd10aa0ff None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:10.342828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:10.343421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:10.343700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:10.343967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:10.345681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:10.443385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:10.461566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:10.463718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abe6a6-1729-47f8-9ff5-c63075b9375c service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:10.486890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 705/1425] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:11.386124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:11.386822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:11.386822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:11.388284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:11.394210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a55995-70a7-470c-897e-4738262a0c2e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:11.394790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a55995-70a7-470c-897e-4738262a0c2e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:11.394790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a55995-70a7-470c-897e-4738262a0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:11.490988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c6a55995-70a7-470c-897e-4738262a0c2e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:11.492337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c6a55995-70a7-470c-897e-4738262a0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:11.603778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:11.763882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:11.765431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:11.856727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:11.925859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b895-08cf-48e2-b74e-a2af12a74507 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:12.056702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:12.057361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:12.057646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:12.057918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:12.059657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:12.110175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:12.154156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:12.155841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cb49-4a61-487e-9ff5-8a101c907329 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:12.175749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 722/1428] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:12.987115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:12.987837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:12.987837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:12.989440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:12.995193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90021-fe33-4dc6-8928-78c8bd881764 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:12.996232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90021-fe33-4dc6-8928-78c8bd881764 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:12.996232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90021-fe33-4dc6-8928-78c8bd881764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:13.087837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cfd90021-fe33-4dc6-8928-78c8bd881764 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:13.089094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cfd90021-fe33-4dc6-8928-78c8bd881764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:13.190169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:13.342834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:13.344341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:13.408067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:13.528911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fb45-6c84-4040-9295-e7e042362881 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:13.652765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:13.653429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:13.653714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:13.653991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:13.655709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:13.663141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:13.760552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:13.762315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daeccd-2db1-43c7-b0c7-185eba4eeb08 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:13.782020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 708/1431] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:14.615147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:14.615773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:14.615773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:14.617784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:14.623114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae1300-638c-4da7-85a9-338d7c5a8463 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:14.623634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae1300-638c-4da7-85a9-338d7c5a8463 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:14.623730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae1300-638c-4da7-85a9-338d7c5a8463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:14.707672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f4ae1300-638c-4da7-85a9-338d7c5a8463 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:14.708927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f4ae1300-638c-4da7-85a9-338d7c5a8463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:14.784235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:14.818024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:14.984453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:14.986006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:15.005377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:15.140248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423433-4ead-4bfd-b4b6-b69294b03720 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:15.246393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:15.276589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:15.277315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:15.277600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:15.277874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:15.279667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:15.408436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:15.410105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994a16-de33-41aa-a018-3ca62e4340c0 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:15.430151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 725/1434] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:16.259128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:16.259765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:16.259765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:16.261895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:16.267480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e169-59a9-4134-a61b-d9910ed91c92 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:16.267943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e169-59a9-4134-a61b-d9910ed91c92 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:16.268049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99e169-59a9-4134-a61b-d9910ed91c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:16.354715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1c99e169-59a9-4134-a61b-d9910ed91c92 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:16.356093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1c99e169-59a9-4134-a61b-d9910ed91c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:16.402754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:16.478350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:16.628889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:16.630454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:16.790186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312244df-5cb9-4f4a-813e-42722a92eb36 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:16.850998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:16.913245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:16.913901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:16.914187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:16.914451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:16.916515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:17.019019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:17.021213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1fe48-4b9c-4db3-afd9-5442ec9b21ae service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:17.042282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 711/1437] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:17.859866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:17.860463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:17.860463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:17.861879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:17.867042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b13c6-a8af-4337-bc25-7875d5457578 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:17.867524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b13c6-a8af-4337-bc25-7875d5457578 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:17.867630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b13c6-a8af-4337-bc25-7875d5457578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:17.948065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fb7b13c6-a8af-4337-bc25-7875d5457578 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:17.949409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fb7b13c6-a8af-4337-bc25-7875d5457578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:17.951966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:18.052553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:18.207688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:18.209205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:18.386471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db0ed-d733-4291-bcb3-5a729f8a2247 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:18.416169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:18.521982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:18.522528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:18.522836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:18.523110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:18.524849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:18.626317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:18.628037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151e09-d094-4fff-9d04-776a88f78bd7 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:18.650475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 728/1440] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:20.634548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:20.635136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:20.635136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:20.636582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:20.642275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70481-6790-4521-910c-849cafb95a32 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:20.642840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70481-6790-4521-910c-849cafb95a32 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:20.642840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70481-6790-4521-910c-849cafb95a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:20.690989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:20.720215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ca70481-6790-4521-910c-849cafb95a32 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:20.721465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ca70481-6790-4521-910c-849cafb95a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:20.829101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:20.868750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:20.870336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:20.982237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2a57-0e7d-42f4-9c5a-b95398f60272 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:21.015504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:21.063960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:21.064622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:21.064903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:21.065176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:21.066849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:21.199331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:21.201054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ecdcc-2e5c-419e-aa6b-08a13fa6d63e service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:21.221568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 714/1443] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:23.527452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:23.528213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:23.528213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:23.529427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:18:23.534991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423e3c-5c93-4b88-bfcf-e87442561e72 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:23.535471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423e3c-5c93-4b88-bfcf-e87442561e72 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:23.535592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423e3c-5c93-4b88-bfcf-e87442561e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:23.605511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-59423e3c-5c93-4b88-bfcf-e87442561e72 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:23.606728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-59423e3c-5c93-4b88-bfcf-e87442561e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:23.623888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:23.745891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:18:23.788369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:23.789975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:23.903184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9afeb-37df-443e-85c0-142796ccbddb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:23.916485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:23.987408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:23.988058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:23.988334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:23.988606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:23.990285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:24.131478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:24.132951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b7f78-dde9-4035-b6a6-7b082890ab46 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:24.151688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 731/1446] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:26.588499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:26.589329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:26.589329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:26.591542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:26.597852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02f55-50df-4d81-a402-8b37379f4285 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:26.598350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02f55-50df-4d81-a402-8b37379f4285 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:26.598447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f02f55-50df-4d81-a402-8b37379f4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:26.651649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:26.670961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-43f02f55-50df-4d81-a402-8b37379f4285 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:26.672221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43f02f55-50df-4d81-a402-8b37379f4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:26.776087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:26.818971 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:26.821329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:26.941359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c83e-244f-4174-a28c-fc34bc4f5422 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:26.990646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:27.028660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:27.029310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:27.029586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:27.029851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:27.031577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:27.156485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:27.158837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b67a4-1c53-4038-84db-29ed671d70b4 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:27.181645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 717/1449] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:29.383834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:29.384451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:29.384451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:29.385751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:29.392340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72021b-62c5-4e97-a7a8-354c7c6e482d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:29.393298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72021b-62c5-4e97-a7a8-354c7c6e482d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:29.393298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72021b-62c5-4e97-a7a8-354c7c6e482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:29.483448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ee72021b-62c5-4e97-a7a8-354c7c6e482d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:29.484937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee72021b-62c5-4e97-a7a8-354c7c6e482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:29.508801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:29.601128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:29.640339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:29.641910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:29.759646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b880b-8968-498a-8ec3-5bcd95990ed1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:29.781590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:29.840582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:29.841254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:29.841539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:29.841833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:29.843687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:29.964932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:29.966407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427fc6b-3856-4fb1-a8f8-1c788dd501d3 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:29.984939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 734/1452] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:32.099702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:32.100598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:32.100598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:32.102993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:32.111537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256899-d2ce-47d8-bf72-15b1b50497c4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:32.112380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256899-d2ce-47d8-bf72-15b1b50497c4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:32.112598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256899-d2ce-47d8-bf72-15b1b50497c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:32.197852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:32.201319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-da256899-d2ce-47d8-bf72-15b1b50497c4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:32.203597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-da256899-d2ce-47d8-bf72-15b1b50497c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:32.315910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:32.354320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:32.355968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:32.466560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa42b4-6b3e-4d8a-9189-f3d5280e4690 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:32.521557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:32.549691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:32.550350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:32.550620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:32.550903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:32.552606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:32.677401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:32.678892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20813-6b46-4368-b881-c2a31371b2b3 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:32.698585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 720/1455] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:34.806925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:34.807868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:34.808044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:34.810560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:34.816921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0507b8-b4d9-4510-b971-56e6a78cb9a3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:34.817445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0507b8-b4d9-4510-b971-56e6a78cb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:34.817445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0507b8-b4d9-4510-b971-56e6a78cb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:34.884335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9a0507b8-b4d9-4510-b971-56e6a78cb9a3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:34.885602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9a0507b8-b4d9-4510-b971-56e6a78cb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:34.918046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:34.993590 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:35.035626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:35.038367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:35.155508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fae2dd-4975-4692-b8e4-bbc2a3c6aeca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:35.187103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:35.238255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:35.238918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:35.239206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:35.239517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:35.241182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:35.363800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:35.365301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cba6-a6bf-44fd-8ffc-15805f9b4ccb service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:35.388458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 737/1458] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:37.515112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.516260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.516260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.517111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:37.523755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029acc-651d-46ec-ba78-7665c5ff223d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.524544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029acc-651d-46ec-ba78-7665c5ff223d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.524544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029acc-651d-46ec-ba78-7665c5ff223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.597107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f1029acc-651d-46ec-ba78-7665c5ff223d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:37.598327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f1029acc-651d-46ec-ba78-7665c5ff223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:37.607151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:37.707362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:37.746267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:37.747863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:37.871988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c296b8-6878-4205-9579-13e4f3f5e543 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:37.929734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:37.949288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:37.949958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.950268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.950543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.952504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:38.076316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:38.077803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6dba-d135-4dc2-9e46-6cb68ff1683b service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:38.098035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 723/1461] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:40.325628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.326239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.326239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.327639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:40.334039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581d46-571a-490f-a9e1-e243d5952778 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.334719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581d46-571a-490f-a9e1-e243d5952778 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.334814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581d46-571a-490f-a9e1-e243d5952778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.411359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c4581d46-571a-490f-a9e1-e243d5952778 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:40.412629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c4581d46-571a-490f-a9e1-e243d5952778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:40.467848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.537465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:40.577685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.579237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:40.693859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537827-3ae4-432a-ab27-fc57b9092341 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.749965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.793190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.793853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.794147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.794415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.796149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:40.918595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.920077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb41f34-b73f-4113-8dbd-84b3dbcb5199 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.938385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 740/1464] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:43.054907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.055511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.055511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.056904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:43.063829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06397-1493-427b-ba11-6651b34bb23f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.064578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06397-1493-427b-ba11-6651b34bb23f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.064767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06397-1493-427b-ba11-6651b34bb23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.150948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aff06397-1493-427b-ba11-6651b34bb23f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:43.152266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aff06397-1493-427b-ba11-6651b34bb23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.171913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.250885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:43.294059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:43.295634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.409332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6cea1-2608-46c0-b976-1cabd8114d72 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:43.487579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.495531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:43.496187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.496462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.496731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.498390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.617703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:43.619212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e91f-0b43-4bb7-8490-c42958dd52fa service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:43.639299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 726/1467] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:45.698267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.698925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.699019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.700446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:45.706972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada15e-5d15-4b43-b71a-4856e905e8d9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.707741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada15e-5d15-4b43-b71a-4856e905e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.707924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada15e-5d15-4b43-b71a-4856e905e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.784333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-37ada15e-5d15-4b43-b71a-4856e905e8d9 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:45.785577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-37ada15e-5d15-4b43-b71a-4856e905e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:45.839807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:45.893761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:45.935534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:45.938100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:46.055530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f7054-3301-4812-8733-b0b9e634f294 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:46.107450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:46.139641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:46.140310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:46.140586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:46.140854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:46.142519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:46.269186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:46.270635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b9f5-c311-4760-8956-cf6e7e7501aa service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:46.289969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 743/1470] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:55.891412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=22 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.287475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=66 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:06.241449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec3da-a083-4599-a404-b8bf600fcb82 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:06.242329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec3da-a083-4599-a404-b8bf600fcb82 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:06.242329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec3da-a083-4599-a404-b8bf600fcb82 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:06.244119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 728/1471] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:06.250224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840ad8-5655-4ae1-a28c-066ddb8e3856 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:06.250702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840ad8-5655-4ae1-a28c-066ddb8e3856 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:06.250831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840ad8-5655-4ae1-a28c-066ddb8e3856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:06.332042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3840ad8-5655-4ae1-a28c-066ddb8e3856 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:06.333266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3840ad8-5655-4ae1-a28c-066ddb8e3856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:06.444879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 744/1472] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:06.536809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:06.537095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:06.537365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:06.538795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 729/1473] 10.222.0.82 () {54 vars in 966 bytes} [Wed Jul 20 19:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:06.545328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292b6f-e7f1-40a9-b7d8-368f75137608 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:06.545721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292b6f-e7f1-40a9-b7d8-368f75137608 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:06.546114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292b6f-e7f1-40a9-b7d8-368f75137608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:06.638427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1c292b6f-e7f1-40a9-b7d8-368f75137608 None None] MFA Rules not processed for user `6c159e59080a41d2b1857c89c6e4c442`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:06.640327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1c292b6f-e7f1-40a9-b7d8-368f75137608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:06.669565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:06.740202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 745/1474] 10.222.0.82 () {58 vars in 1063 bytes} [Wed Jul 20 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:06.748589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:06.751123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:06.871924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1f7f-0762-429e-88ec-d19b42d2b898 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:06.975855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:06.976811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:06.977282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:06.977631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:06.980263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:07.040574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:07.107535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:07.109008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0171e-2efd-4ec8-861e-475c41b2e57b service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:07.129171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 730/1475] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:09.298221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.298801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.298801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.300313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 746/1476] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:09.307729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeae61-e574-4b24-a9aa-839b89df09d3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.308526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeae61-e574-4b24-a9aa-839b89df09d3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.308813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeae61-e574-4b24-a9aa-839b89df09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.380179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a0aeae61-e574-4b24-a9aa-839b89df09d3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:09.381490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a0aeae61-e574-4b24-a9aa-839b89df09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:09.490301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 731/1477] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:09.514579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:09.516196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:09.662434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154c0f-2116-42c1-bfd3-38b12c0a9927 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:09.722469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:09.770648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:09.771330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.771624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.771898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.772635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:09.774473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:19:09.774473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:19:09.774473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:19:09.775671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff758-076c-4249-a5ca-007dbf994c78 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:09.795804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 747/1478] 10.222.0.82 () {56 vars in 1108 bytes} [Wed Jul 20 19:19:09 2022] GET /identity/v3/projects => generated 2553 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:19:11.873127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:11.873786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:11.873786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:11.875231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 732/1479] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:11.880664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15efb-41d6-484c-b1a7-43e91b7c3002 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:11.881130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15efb-41d6-484c-b1a7-43e91b7c3002 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:11.881262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15efb-41d6-484c-b1a7-43e91b7c3002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:11.948457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e7c15efb-41d6-484c-b1a7-43e91b7c3002 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:11.949695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e7c15efb-41d6-484c-b1a7-43e91b7c3002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:12.048310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 748/1480] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:12.092058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:12.093598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:12.103717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:12.253343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63af2-9222-4b46-9b95-490d20baceb0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:12.351965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:12.515791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:12.516356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.516634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.516908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.518759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:12.629047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:12.630683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214eb06-594b-4a53-951a-b96949ccfbe6 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:12.650172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 733/1481] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:14.911737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:14.912274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:14.912274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:14.913562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 749/1482] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:14.919855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f618d-062a-4c08-acd7-c1e9a22de411 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:14.920558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f618d-062a-4c08-acd7-c1e9a22de411 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:14.920654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f618d-062a-4c08-acd7-c1e9a22de411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:14.991916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8c1f618d-062a-4c08-acd7-c1e9a22de411 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:14.993131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8c1f618d-062a-4c08-acd7-c1e9a22de411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:15.044634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:15.097168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 734/1483] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:15.133890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:15.135525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:15.163977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:15.296580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b729a1d-8c4c-43f4-94f6-931b4c2387fe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:15.370922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:15.371678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:15.372016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:15.372342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:15.374045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:15.463216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:15.501919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:15.503416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd685-c270-4289-8958-3928acfcaf58 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:15.522489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 750/1484] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:17.625915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:17.626529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:17.626529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:17.627885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 735/1485] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:17.634614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00a5a-260d-43a8-80b5-8db250e2eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:17.635611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00a5a-260d-43a8-80b5-8db250e2eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:17.635611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00a5a-260d-43a8-80b5-8db250e2eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:17.703613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-55d00a5a-260d-43a8-80b5-8db250e2eaf2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:17.704887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-55d00a5a-260d-43a8-80b5-8db250e2eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:17.814461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 751/1486] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:17.856261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:17.858533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:17.978028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3e86e-2d58-4ecc-8b33-154298d41409 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:18.064324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:18.066680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:18.067633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:18.067974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:18.068351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:18.072150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:18.201936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:18.203527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5131-4c89-4e28-aacd-b97c9c16b4c1 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:18.228240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 736/1487] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:20.387137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:20.388362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:20.388362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:20.390831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 752/1488] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:20.397815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8eb2-479f-4f40-8457-8d3e78be434d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:20.398537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8eb2-479f-4f40-8457-8d3e78be434d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:20.398756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8eb2-479f-4f40-8457-8d3e78be434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:20.472154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-01fc8eb2-479f-4f40-8457-8d3e78be434d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:20.473257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-01fc8eb2-479f-4f40-8457-8d3e78be434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:20.526152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:20.581186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 737/1489] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:20.622250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:20.623884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:20.662152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:20.737624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f80b4-ae37-438a-a181-7dfdd13b8acd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:20.819848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:20.820520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:20.820798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:20.821052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:20.822766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:20.909343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:20.952075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:20.954236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ea8e-df40-452a-9719-ef33b3013efe service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:20.978455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 753/1490] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:23.287055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:23.287718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:23.287718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:23.290195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 738/1491] 10.222.0.82 () {54 vars in 926 bytes} [Wed Jul 20 19:19:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:23.295814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fc11-07ba-4525-9b11-893b549c627d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:23.296309 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fc11-07ba-4525-9b11-893b549c627d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:23.296406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fc11-07ba-4525-9b11-893b549c627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:23.363915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7468fc11-07ba-4525-9b11-893b549c627d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:23.365165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7468fc11-07ba-4525-9b11-893b549c627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:23.480658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 754/1492] 10.222.0.82 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:19:23.524024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:23.525656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:23.639595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f278ef-206f-43e4-af60-97673891fe96 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:23.723383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:23.724050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:23.724331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:23.724600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:23.726319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:23.736996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:23.865081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:23.867419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f5c28-6ebb-4d51-8ede-9aca8d9d05d3 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:23.889252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 739/1493] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:33.477943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=82 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:33.886642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=50 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:51.396926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:51.397550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:51.397550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:51.481689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:51.482901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:51.600795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 755/1494] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:51.609231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:51.609788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:51.609788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:51.692895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:51.694124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:51.813479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 740/1495] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:51.818526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:51.819836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:51.832558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a78d-ca42-4213-9b96-d809bb780fcc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:51.911590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:51.954433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:51.955451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:51.955849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:51.956186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:51.957405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:20:51.957659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:51.959211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:51.959211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:20:51.959211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:20:51.960516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:51.974593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 756/1496] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:20:51.983890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:51.997905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8158e-37b8-4819-b593-d6fd50bfb68b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:52.061636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:52.096949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:52.097612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.097885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.098145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:52.098858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:52.100629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:52.100629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:20:52.100629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:20:52.101820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:52.159075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 741/1497] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:20:51 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:20:52.164052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:52.165577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:52.205406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d60c-8977-4117-9660-662cfeb786dc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:52.312015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:52.312690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.312966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.313245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:52.313934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:52.314968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:52.314968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:20:52.314968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:20:52.316220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:52.359994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 757/1498] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:20:52 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:20:52.365128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:52.367546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:52.442106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c15ed-fbff-41fd-a23f-6b9bacafc3d6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:52.532926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:52.547083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:52.548103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.548412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.548682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:52.549830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:52.551282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:52.551282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:20:52.551282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:20:52.552503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:52.569829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 742/1499] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:20:52.574688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:52.576916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:52.593502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4237-d985-4bb6-9470-09e194f809d0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:52.621281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:52.695803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:52.696388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.696670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.696942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:52.697680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:52.698708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:52.698708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:20:52.698708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:20:52.699838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbd11f-aca3-4138-9ff6-ddb2c854d72c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:52.713300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 758/1500] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:20:52.717871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:52.719456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:52.757224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a601-8700-4f7d-8329-3229e91be166 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:52.862629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:52.863566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.863840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.864081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] PATH_INFO: `/v3/projects/16dd049815ed4d2ea221634b1e802f1c/users/a96baae6a4614959ad92c6194e20dff4/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:52.889234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dd049815ed4d2ea221634b1e802f1c, user_id=a96baae6a4614959ad92c6194e20dff4, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:52.890298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:52.890298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:20:52.890298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:20:52.892283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7913175-8255-4f8f-8f86-f7a2386d1672 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:52.923034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 743/1501] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:20:52 2022] PUT /identity/v3/projects/16dd049815ed4d2ea221634b1e802f1c/users/a96baae6a4614959ad92c6194e20dff4/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:20:52.938521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef416d-91f7-449b-aa74-4016daeb169c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:52.938809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef416d-91f7-449b-aa74-4016daeb169c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:52.939081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef416d-91f7-449b-aa74-4016daeb169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.007899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e6ef416d-91f7-449b-aa74-4016daeb169c None None] MFA Rules not processed for user `a96baae6a4614959ad92c6194e20dff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:53.009549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e6ef416d-91f7-449b-aa74-4016daeb169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:53.117462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 759/1502] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:53.138087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:53.138388 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:53.138642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.140447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 744/1503] 10.222.0.82 () {54 vars in 964 bytes} [Wed Jul 20 19:20:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:20:53.145704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a5bc-0fd3-431f-acbf-084e7e55771d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:53.145987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a5bc-0fd3-431f-acbf-084e7e55771d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:53.146261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a5bc-0fd3-431f-acbf-084e7e55771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.178209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:53.228086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c727a5bc-0fd3-431f-acbf-084e7e55771d None None] MFA Rules not processed for user `4bacfdb698cf41dfb6be9a0e94daf371`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:53.229333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c727a5bc-0fd3-431f-acbf-084e7e55771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:53.316838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 760/1504] 10.222.0.82 () {58 vars in 1061 bytes} [Wed Jul 20 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:53.325722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:53.327258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:53.381658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:53.442086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5b1f-11f7-4b68-8f72-8048d0593be4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:53.533787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:53.534644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:53.534977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:53.535298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.537857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:53.661724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:53.663214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:53.667173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:53.682981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 745/1505] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:20:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:20:53.732296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65444c-505f-4c8e-a62a-c101e023c64d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:53.732795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65444c-505f-4c8e-a62a-c101e023c64d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:53.732901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65444c-505f-4c8e-a62a-c101e023c64d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.734649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 761/1506] 10.222.0.82 () {52 vars in 829 bytes} [Wed Jul 20 19:20:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:20:53.739885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:53.741243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:53.875169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b50abd-e472-4cd2-9875-5c0955d02997 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:53.982205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:53.983095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:53.983398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:53.983672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] PATH_INFO: `/v3/users/a96baae6a4614959ad92c6194e20dff4` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:53.998286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96baae6a4614959ad92c6194e20dff4)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:53.999376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:53.999376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:20:53.999376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:20:54.000615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:54.011166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:54.071337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96baae6a4614959ad92c6194e20dff4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:54.084893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96baae6a4614959ad92c6194e20dff4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:54.096603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96baae6a4614959ad92c6194e20dff4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:54.097252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96baae6a4614959ad92c6194e20dff4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:54.097915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96baae6a4614959ad92c6194e20dff4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:54.131043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 746/1507] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:20:53 2022] DELETE /identity/v3/users/a96baae6a4614959ad92c6194e20dff4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:20:54.135996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:54.136289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:54.136567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:54.196985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:54.198181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:54.284865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:54.298895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 762/1508] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:54.309567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:54.311416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:54.425024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855da6-b6d5-4db7-91de-5ef4871d9f70 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:54.489335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:54.511336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:54.512681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:54.512913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:54.513184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:54.514859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:54.633034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:54.634528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee980b-5b1f-4c3e-bc4e-283ea08a355c service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:54.654799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 747/1509] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:20:55.011695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:55.012981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:55.027331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36938e-5845-4d66-98db-634987d63f18 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:55.130497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:55.131413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:55.131688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:55.131961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] PATH_INFO: `/v3/projects/16dd049815ed4d2ea221634b1e802f1c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:55.143067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dd049815ed4d2ea221634b1e802f1c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:55.144182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:55.144182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:20:55.144182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:20:55.145412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:55.214734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dd049815ed4d2ea221634b1e802f1c', 'request_id': 'req-64e839c1-4b55-44a9-a80c-ee21fcd101ce'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:55.225766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dd049815ed4d2ea221634b1e802f1c', 'request_id': 'req-64e839c1-4b55-44a9-a80c-ee21fcd101ce'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:55.240865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dd049815ed4d2ea221634b1e802f1c', 'request_id': 'req-64e839c1-4b55-44a9-a80c-ee21fcd101ce'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:55.266598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] The token cache is being invalidate because project 16dd049815ed4d2ea221634b1e802f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:20:55.266885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:55.267450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64e839c1-4b55-44a9-a80c-ee21fcd101ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:55.268864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 763/1510] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:20:55 2022] DELETE /identity/v3/projects/16dd049815ed4d2ea221634b1e802f1c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:21:04.652400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=62 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:05.264506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:45.462974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:45.463686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:45.463686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:45.464960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:45.471377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131684-2c4a-4975-bb04-002e5d83c256 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:45.472240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131684-2c4a-4975-bb04-002e5d83c256 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:45.472240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131684-2c4a-4975-bb04-002e5d83c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:45.701923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-28131684-2c4a-4975-bb04-002e5d83c256 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:45.703348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-28131684-2c4a-4975-bb04-002e5d83c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:45.827501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:45.983484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:45.986051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:46.129161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c581a18-152e-4f00-b3ba-3d390f069fdc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:46.135264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:46.135941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.136229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.136502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:46.145281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:46.146895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1970ab1-8a0d-42a6-9e8b-02c3b05124db service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:46.157503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 749/1513] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:46.952244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e4dc-db9a-454e-843f-98721da80548 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.952811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e4dc-db9a-454e-843f-98721da80548 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.952811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e4dc-db9a-454e-843f-98721da80548 None None] PATH_INFO: `/v3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:46.954147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 765/1514] 10.222.0.87 () {54 vars in 925 bytes} [Wed Jul 20 19:22:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:22:46.961244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994315-5d9b-48e0-8a7e-a892afbec1b9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.961710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994315-5d9b-48e0-8a7e-a892afbec1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.961804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994315-5d9b-48e0-8a7e-a892afbec1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:47.016709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936ab9-a0f9-472c-b0cf-2ebef8c4296d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:47.017044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936ab9-a0f9-472c-b0cf-2ebef8c4296d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:47.017261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936ab9-a0f9-472c-b0cf-2ebef8c4296d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:47.018633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 766/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:22:47.023422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:47.023708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:47.023976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:47.030064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-56994315-5d9b-48e0-8a7e-a892afbec1b9 None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:47.031290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-56994315-5d9b-48e0-8a7e-a892afbec1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:47.042727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:47.044033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:47.051943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 767/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:22:47.101800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:47.107554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 750/1517] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:47.206255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:47.223677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b73704-2809-4bb6-8181-c703f1e543c9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:47.230286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:47.230944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:47.231239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:47.231528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:47.241078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:47.242734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd61793-ece8-4384-a02e-c76ea18ba381 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:47.252919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 768/1518] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:56.765232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bb22a-169d-4c0d-b664-a9cb05cd062e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:56.765810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bb22a-169d-4c0d-b664-a9cb05cd062e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:56.765810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bb22a-169d-4c0d-b664-a9cb05cd062e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:56.767238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 751/1519] 10.222.0.82 () {54 vars in 961 bytes} [Wed Jul 20 19:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:56.772725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71b6e-1cbd-4fb4-96d7-2326bdfcc596 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:56.773196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71b6e-1cbd-4fb4-96d7-2326bdfcc596 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:56.773307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71b6e-1cbd-4fb4-96d7-2326bdfcc596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:56.793166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-24d71b6e-1cbd-4fb4-96d7-2326bdfcc596 None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:56.794359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-24d71b6e-1cbd-4fb4-96d7-2326bdfcc596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:56.804103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 769/1520] 10.222.0.82 () {58 vars in 1058 bytes} [Wed Jul 20 19:22:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:22:56.812042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bb22a-169d-4c0d-b664-a9cb05cd062e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:56.832058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bb22a-169d-4c0d-b664-a9cb05cd062e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:56.839793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:56.840706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:56.841195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:56.841482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:56.851582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:56.853195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9054b-94a3-4d49-b691-323ed462b0d9 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:56.862758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 752/1521] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:58.493392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59380-7e73-448f-abc4-bef70ab61e38 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:58.494283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59380-7e73-448f-abc4-bef70ab61e38 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:58.494283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59380-7e73-448f-abc4-bef70ab61e38 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:58.496468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:58.505111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c60a-06a7-47cc-8231-cd276fd500ae None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:58.505581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c60a-06a7-47cc-8231-cd276fd500ae None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:58.505686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c60a-06a7-47cc-8231-cd276fd500ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:58.526559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c2a1c60a-06a7-47cc-8231-cd276fd500ae None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:58.527860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2a1c60a-06a7-47cc-8231-cd276fd500ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:58.537784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:58.695070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c59380-7e73-448f-abc4-bef70ab61e38 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:58.710679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c59380-7e73-448f-abc4-bef70ab61e38 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:58.716746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:58.717407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:58.717689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:58.717962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:58.726980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:58.728649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417b52e-e3c0-4de2-956c-9e1e56cf689b service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:58.738867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 771/1524] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:22:59.547988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4606-f7bb-4de5-87a7-3545e2de84f9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:59.548574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4606-f7bb-4de5-87a7-3545e2de84f9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:59.548574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4606-f7bb-4de5-87a7-3545e2de84f9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:59.549960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:59.555224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d105d-1fc5-47c0-8f8c-ac18362f6374 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:59.555715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d105d-1fc5-47c0-8f8c-ac18362f6374 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:59.555812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d105d-1fc5-47c0-8f8c-ac18362f6374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:59.575218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-448d105d-1fc5-47c0-8f8c-ac18362f6374 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:59.576446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-448d105d-1fc5-47c0-8f8c-ac18362f6374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:59.586273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:59.740988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4606-f7bb-4de5-87a7-3545e2de84f9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:59.757979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4606-f7bb-4de5-87a7-3545e2de84f9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:59.763821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:59.764492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:59.764776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:59.765049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:59.776354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:59.777472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5243db-572e-49ab-bbcd-af64e72b9963 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:59.788746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 755/1527] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:23:04.060330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:04.060929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:04.060929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:04.062299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:23:04.068292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93427-9758-4b60-9a14-a3585953a382 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:04.068730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93427-9758-4b60-9a14-a3585953a382 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:04.068849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93427-9758-4b60-9a14-a3585953a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:04.090564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-94e93427-9758-4b60-9a14-a3585953a382 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:23:04.091866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-94e93427-9758-4b60-9a14-a3585953a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:04.101499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:23:04.180174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:23:04.183243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:04.218475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:04.277866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f9af-e747-4584-ae86-3de656b648ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:23:04.281938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:23:04.282759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:04.283047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:04.283340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:04.294136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:23:04.295630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2510e5e-90cc-4bad-b05e-58356e626aa2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:23:04.305588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 774/1530] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:23:06.336691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10abe-b7e3-4e76-a30d-67841d49f1bc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:06.337095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10abe-b7e3-4e76-a30d-67841d49f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:06.337276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10abe-b7e3-4e76-a30d-67841d49f1bc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:06.338807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:23:06.346107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632b1-5e12-40f2-9373-ae07726513c0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:06.346593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632b1-5e12-40f2-9373-ae07726513c0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:06.346700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a632b1-5e12-40f2-9373-ae07726513c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:06.376945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-14a632b1-5e12-40f2-9373-ae07726513c0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:23:06.378168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-14a632b1-5e12-40f2-9373-ae07726513c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:06.388418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:23:06.429473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10abe-b7e3-4e76-a30d-67841d49f1bc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:23:06.446302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10abe-b7e3-4e76-a30d-67841d49f1bc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:23:06.452606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:23:06.453256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:06.453582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:06.453937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:06.468694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:23:06.470754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a0a72-9d9f-46f5-8b90-a31be845760c service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:23:06.480927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 758/1533] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:23:10.417810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:10.418643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:10.418831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:10.420994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:23:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:23:10.427460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57686-0dd1-4f1b-9433-494190efa4d5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:10.427913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57686-0dd1-4f1b-9433-494190efa4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:10.428032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57686-0dd1-4f1b-9433-494190efa4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:10.447620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-16f57686-0dd1-4f1b-9433-494190efa4d5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:23:10.448823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-16f57686-0dd1-4f1b-9433-494190efa4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:10.457833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:23:10.771723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:23:10.773660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:10.876907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c999-957f-4a3b-9f5c-b4b1f29c5588 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:23:10.881291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:23:10.881948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:10.882224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:10.882495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:10.892246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:23:10.893675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631270-06e7-44a9-8ade-d07582d931ae service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:23:10.903672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 777/1536] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:23:12.966187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:12.966780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:12.966780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:12.968173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:23:12.974645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958364-8c53-496e-adca-e9db0aa1f231 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:12.975114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958364-8c53-496e-adca-e9db0aa1f231 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:12.975219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958364-8c53-496e-adca-e9db0aa1f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:12.998150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f0958364-8c53-496e-adca-e9db0aa1f231 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:23:12.999393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f0958364-8c53-496e-adca-e9db0aa1f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:13.010517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:23:13.315939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:23:13.318147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:23:13.332819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653840c-d9ab-4060-9d1b-28468be2de90 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:23:13.337879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:23:13.339024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:23:13.339389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:23:13.339799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:23:13.354951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:23:13.357173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb13bd1-ce3d-4e2a-b92f-c5d5bd668acf service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:23:13.371932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 761/1539] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:23:22.992997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=66 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:23.365519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=34 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:46.244888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.246296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.246675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.269186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.270409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.282416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 779/1540] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.291022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.291625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.291625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.318198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.319539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.334269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 762/1541] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.339793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.356310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72938042-6a2d-4f57-b1c9-22d7ab6d2b1d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.364137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.365028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.365227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.365457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.366236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:46.366543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.368535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.391594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 780/1542] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:46.403047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.418384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ca7b-056f-4c13-8857-b533291412e7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.424355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.425477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.425929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.426367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.427279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.429598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eff2ec-034c-47b0-b7c5-4b805c26b778 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.494155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 763/1543] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:46.500726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.515655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8c4c-6c52-492c-8e19-38f95e9f9ca7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.612579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9e8a-6e65-4a37-9c2b-28c625c075de None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.612955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9e8a-6e65-4a37-9c2b-28c625c075de None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.613159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9e8a-6e65-4a37-9c2b-28c625c075de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.620317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.621040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.621321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.621592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.622531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.625015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4cea0-a39e-4b59-a335-7863761a9ffc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.641487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-79bf9e8a-6e65-4a37-9c2b-28c625c075de None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.642762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-79bf9e8a-6e65-4a37-9c2b-28c625c075de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.658785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 764/1544] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.661602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bfa71-f826-4295-88d2-ec9130052097 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.661824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bfa71-f826-4295-88d2-ec9130052097 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.662103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bfa71-f826-4295-88d2-ec9130052097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.677550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 781/1545] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:46.678863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.679153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.679794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.706758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7d8bfa71-f826-4295-88d2-ec9130052097 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.708152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d8bfa71-f826-4295-88d2-ec9130052097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.728967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.732567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.737353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 765/1546] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.738678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e7ae-93e1-406d-964f-7727ba056624 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.738963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e7ae-93e1-406d-964f-7727ba056624 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.739236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e7ae-93e1-406d-964f-7727ba056624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.762027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 782/1547] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.762869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.797645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f41ad-2a7b-4714-84d0-323abf4e47e2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.800155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7286e7ae-93e1-406d-964f-7727ba056624 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.802832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7286e7ae-93e1-406d-964f-7727ba056624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.810777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.811556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.811835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.812106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.813226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.815193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.823705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 766/1548] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.825096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa2c-6849-42fb-8de3-2ea0041f674f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.825379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa2c-6849-42fb-8de3-2ea0041f674f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.825646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa2c-6849-42fb-8de3-2ea0041f674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.848401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 783/1549] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:46.849299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.876179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2e1efa2c-6849-42fb-8de3-2ea0041f674f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.879493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e05b5-b46c-4e66-b4ec-84d7b22e5602 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.880875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2e1efa2c-6849-42fb-8de3-2ea0041f674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.889555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.890630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.890914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.891187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.893598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:46.893908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.895569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.899825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 767/1550] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.901327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4158-c6a8-4418-a3d6-8e2b36d9cfab None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.902076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4158-c6a8-4418-a3d6-8e2b36d9cfab None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.902349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4158-c6a8-4418-a3d6-8e2b36d9cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.926128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 784/1551] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:46.926615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3c5a4158-c6a8-4418-a3d6-8e2b36d9cfab None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.927016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.932663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3c5a4158-c6a8-4418-a3d6-8e2b36d9cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.944712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 768/1552] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.945681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb90a7-26e2-43f0-bcb0-a03a573c0b0a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.947034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d1e-8b51-45e8-831a-96afe1889748 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.947625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d1e-8b51-45e8-831a-96afe1889748 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.948184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac4d1e-8b51-45e8-831a-96afe1889748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.950929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.951648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.951931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.952201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.952937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.954571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.966731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 785/1553] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:46.967559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b6ac4d1e-8b51-45e8-831a-96afe1889748 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:46.968229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.969046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b6ac4d1e-8b51-45e8-831a-96afe1889748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.977482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 769/1554] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.979167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.982075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.982075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.986735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fd0c4-0ce2-4b32-a82b-d28025ca7758 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.991955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.992637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.992915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.993185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.993915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:46.994211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.996115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27d50-86f5-4beb-9fcf-9941401f4931 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.000868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.002153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.010024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 786/1555] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:47.011429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.011717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.012025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.013203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 770/1556] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.014338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.026229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2494f8-b6eb-40cb-91c6-d5c7c6c6b6ce None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.032577 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.034012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.034300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.034574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.035793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.037750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.039598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.040961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.050470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 787/1557] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.051180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.062270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729431-cc9a-4553-8c46-ced51b543dc3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.067925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.068624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.068908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.069177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.069915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:47.070212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.071889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd723e-640a-4e38-ada1-154ba2871268 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.073381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 771/1558] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.074564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.086273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 788/1559] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:47.087627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.087925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.088357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.112864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.114086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.156903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104645a-2b50-4aa9-99f7-227900c86901 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.162296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.163254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.163557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.163887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] PATH_INFO: `/v3/projects/0798cac60e864329a8ac6ce61e87ce75/users/098429887fdb41ddb00c7a50cc5d54fa/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.169072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:47.181441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0798cac60e864329a8ac6ce61e87ce75, user_id=098429887fdb41ddb00c7a50cc5d54fa, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.182015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 789/1560] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.182858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.184886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f379-4d60-4ee4-bec9-33150be52f2f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.193253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da932-1de2-4b8f-b9e3-a03e78384d2d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.198623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.199391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.199668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.199930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.200661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.201737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:47.201737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:24:47.201737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:24:47.202965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e6fb5-46c5-4d47-99f9-6faffdc072ae admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.206097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 772/1561] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:47 2022] PUT /identity/v3/projects/0798cac60e864329a8ac6ce61e87ce75/users/098429887fdb41ddb00c7a50cc5d54fa/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:47.207827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.208046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.208290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.231872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.233126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.241723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 790/1562] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.241723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.241723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.241723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.260010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.261281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.274277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:47.305109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 773/1563] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.305884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.315615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525b20-3c65-4dbb-9649-cadb8d890847 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.333928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 791/1564] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.333928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.344495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05687-2b22-4ac2-9b34-59ef481c5001 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.350137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.350832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.351116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.351409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.352116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.354075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0208d0-c14e-4412-b753-2ee4cb67249b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.378847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.379573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.379855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.380127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.380842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.381879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:47.381879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:24:47.381879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:24:47.382426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 792/1565] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.383194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.383908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12cc3-aada-454a-b68b-e5493b17caec None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.384296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12cc3-aada-454a-b68b-e5493b17caec None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.384569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12cc3-aada-454a-b68b-e5493b17caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.403994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ad12cc3-aada-454a-b68b-e5493b17caec None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.405320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ad12cc3-aada-454a-b68b-e5493b17caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.413085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 774/1566] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.414905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.426226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dec39-797e-4f42-aad2-d4a4c7f3c6f7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.475156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 793/1567] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.483545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.483838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.484123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.485439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.486118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.486458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.486754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.487493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:47.487804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.488856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:47.488856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:24:47.488856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:24:47.489761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.509449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 775/1568] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:47.509449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.509766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.509766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.513891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 794/1569] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.514578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3411b-840b-4ce9-a270-d2e6d17ba962 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.514826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.521885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.522574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.522856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.523192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.523984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.525996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30ae70-b0f9-49a4-bf10-096b6f1e7af6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.526133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.531482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.532174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.532435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.532702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.533580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:47.533911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.535927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.550029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 776/1571] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.557474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 795/1571] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:47.557474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.557687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.564394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa364245-16c5-43d3-bf6c-35503e61ed0c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.565860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a764f-4e2c-4891-b64e-a7b1a1378e11 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.569801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.570484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.570768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.571041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.571692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.572269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:47.572382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.572634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.572747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.572904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.573597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.574856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.575544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693daed5-fb47-4c59-a83c-6b497af49f75 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.587609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 777/1572] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:47.588502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.600437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b881ad4-442c-4ad3-8368-f0ef4477c80a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.606203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.606888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.607353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.607708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 796/1573] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/users => generated 283 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.607995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.608599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.610394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.612269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.612556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.612862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.622334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 778/1574] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:47.622640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.634099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8312857-5c60-4295-a603-7b3d3e054d6f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.636985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.638214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.638962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.639653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.639937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.640214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.640914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.645833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.650231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 797/1575] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.650440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.651773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.664095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:47.666442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:47.680180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 779/1576] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.680180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.712559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b3b2f-8fab-42fb-bda8-091fcf93c1e4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.753144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbc7f-ac6e-4cda-a7e6-571fa630123b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.757916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.758596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.758878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.759161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.759913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.761601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.772008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.772672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.772951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.773213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.773354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 780/1577] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:47.774096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.783677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.785067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.789956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975978-9386-46b1-a8cd-b0da9209965a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.795732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 798/1578] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:47.796514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.796657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.797431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.797713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.797984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.798711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.800692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.806367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6ed-6ff2-4ab1-8eab-9ae31f05b81f service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.812169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.812169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.812481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.812659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.813389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.815507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.837032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 781/1579] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.838164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.853562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 799/1580] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:47.854285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.934950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e92e5-183c-4770-9d9b-f4f89a73ba0e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.935882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bce7-13ec-4a07-8661-2c313c9fcc7d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.940496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.941349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.941637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.941966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.942079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.942708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.942859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.943050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.943432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.944132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.944434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.946037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.956847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 800/1581] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:47.958186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.963654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 782/1582] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:47.966331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.970514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844c75f-a433-4f7c-99e3-4ae4cc3da56d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.975907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.976521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.976866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.977176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.977948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:47.978838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e39-1b54-4e3e-9f12-5c7169a003c3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.978987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.980144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.985096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.985902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.986131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.986457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.987184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.989893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.996712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 801/1583] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:48.000631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.015522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3498a5c-ead8-4053-9531-b3d6a97097e3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.020851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 783/1584] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.021764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.026325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.027040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.027368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.027629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.028401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.030792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.035601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a43bd-4a2b-42cd-8069-32496d59509b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.041580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.042278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.042669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.042829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.043662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.051228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 802/1585] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.051228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.051586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.064912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c17c-e09f-478f-bdf6-998e88eb43c1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.075255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.077246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.077697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.078173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.078394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 784/1586] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.079223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.079356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.081619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.092199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5493-9a70-4057-88ff-5f9384185533 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.098611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.099500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.099777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.100035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] PATH_INFO: `/v3/projects/3b9e0e5b42524acbb1a493afec2f7b5d/users/fb948dd3d4f446c29f6e4a1606033fe9/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.101952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.117923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 803/1587] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/users => generated 284 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.117923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.121148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e0e5b42524acbb1a493afec2f7b5d, user_id=fb948dd3d4f446c29f6e4a1606033fe9, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.124491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.129273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d616cb-cee7-442c-b16f-b5646625fc0c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.134917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.135759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.136085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.136426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.137284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.138966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.140994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 785/1588] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:48 2022] PUT /identity/v3/projects/3b9e0e5b42524acbb1a493afec2f7b5d/users/fb948dd3d4f446c29f6e4a1606033fe9/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:48.149066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.152444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 804/1589] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.153391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.166452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db47b4-bda2-4229-88dc-5d0aeb2cf865 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.170572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.235909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.236859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.237488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.237864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.239161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.241169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.252467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08832-ca55-4aab-ba33-7f479f6324a1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.255258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 805/1590] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.256347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.258607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.259615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.259907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.260199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.261076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.263158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.276598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1022-0d71-43a2-992c-f1211ef66a19 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.284132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.285049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.285735 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.286037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] PATH_INFO: `/v3/projects/35a21c3a1a9145c8a34989448a263bde/users/048ff38a084747338fb6d69ed0ab9644/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.303010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 786/1591] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.304271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.305792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a21c3a1a9145c8a34989448a263bde, user_id=048ff38a084747338fb6d69ed0ab9644, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.307283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:48.307283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:24:48.307283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:24:48.311555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.330990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 806/1592] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:48 2022] PUT /identity/v3/projects/35a21c3a1a9145c8a34989448a263bde/users/048ff38a084747338fb6d69ed0ab9644/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:48.331968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.381969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d32650-13de-416a-8da1-d3ec1909058f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.408154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8d6a-3c9a-4d59-bbfa-8f2a79bbe981 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.413971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.414659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.415069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.415399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.416136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.417765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ba9a-6710-4c52-8d3b-2e2cb8d8102e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.429714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 807/1593] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.431340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.431726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.432322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.453627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.454332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.454606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.454908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.456025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.458164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.461202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] MFA Rules not processed for user `fb948dd3d4f446c29f6e4a1606033fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:48.462521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.472978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 787/1594] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.472978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.487778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df634bf-958b-49b2-a826-1c2f7cd94182 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.494082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.495066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.495908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.496189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] PATH_INFO: `/v3/projects/4485e390473a464e904a1e5ac9525778/users/8ad4132ff66046c89c388e48922ba8f5/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.519503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4485e390473a464e904a1e5ac9525778, user_id=8ad4132ff66046c89c388e48922ba8f5, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.524724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.525946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.551328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 788/1595] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:48 2022] PUT /identity/v3/projects/4485e390473a464e904a1e5ac9525778/users/8ad4132ff66046c89c388e48922ba8f5/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:48.554358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 808/1596] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:48.555240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.555480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.576505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.580652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933e1d1-a23f-4833-a7cb-6f98746cb9f5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.655795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1ffe5-cb72-405a-9c13-e3cc11996ad2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.662252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.663048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.663615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.664007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.665909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.668553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.668982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.669687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.669971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.670271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.678916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.681186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac76f4-0a88-499f-b61a-c12f90722dab admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.697121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 809/1597] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.697121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.697121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.697121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.698103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 789/1598] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.699107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.718707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a371ae-84a9-4f73-83d6-c1c9bebe9e47 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.725019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.725835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.726474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.726886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.727099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:48.728086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.728570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.730245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.740540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 810/1599] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:48.741475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.749864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 790/1600] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.750955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.752729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2cbb5-25b3-4998-8be9-dc5b5e5cc0d8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.757710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.758399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.758711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.758986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.759786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.761616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793101d5-f32e-40e6-94f6-526c0f79d3e9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.768881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35be424-2dae-4667-a731-72b1640eb2b8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.774440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 811/1601] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:48.775765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.775959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.776254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.776576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.777579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.779860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.780331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.781201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.787521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.806529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] MFA Rules not processed for user `8ad4132ff66046c89c388e48922ba8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:48.807706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.831823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 791/1602] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:48.831823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.899235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 812/1603] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:48.900229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.913368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d47b-90ae-4fed-b8b8-47d3c7b3ba64 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.948315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99260-596e-484e-83cd-4d6245fe5cfa admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.964902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.965909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.966248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.966584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] PATH_INFO: `/v3/projects/2cbdbe7db9f54423a1f54538297f4919/users/f6c8fbe67885443b8e373c8af032f86f/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.977436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.987503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.988207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.988492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.988828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.989571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.991284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.004646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 813/1604] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:49.005566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.006047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbdbe7db9f54423a1f54538297f4919, user_id=f6c8fbe67885443b8e373c8af032f86f, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.009284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.045297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 792/1605] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:48 2022] PUT /identity/v3/projects/2cbdbe7db9f54423a1f54538297f4919/users/f6c8fbe67885443b8e373c8af032f86f/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:49.046420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.093736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5700fe-1a87-4048-af94-d316caba246d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.124130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.139353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75e215-618c-479b-be11-62abc8785851 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.147583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.148531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.148811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.149217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] PATH_INFO: `/v3/projects/398cf27d47404ad49569ea3d503fcfc1/users/99e2385751784d2d9f906fac039ab5ab/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.166053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.167288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.167485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.167764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.176914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398cf27d47404ad49569ea3d503fcfc1, user_id=99e2385751784d2d9f906fac039ab5ab, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.179245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.180499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.180795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.193533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 814/1606] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:49.194474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.205997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3080fe-854b-4454-99c1-ff48af59d16c service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.223940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 793/1607] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:49 2022] PUT /identity/v3/projects/398cf27d47404ad49569ea3d503fcfc1/users/99e2385751784d2d9f906fac039ab5ab/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:49.225924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.297978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.298947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.299212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.299538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] PATH_INFO: `/v3/projects/8d4f43aa44654db490506bd6255f893b/users/5fe7bb321ebf4bcb900cc5d6b7ee5517/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.317388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4f43aa44654db490506bd6255f893b, user_id=5fe7bb321ebf4bcb900cc5d6b7ee5517, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.320226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.344695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 815/1608] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:49 2022] PUT /identity/v3/projects/8d4f43aa44654db490506bd6255f893b/users/5fe7bb321ebf4bcb900cc5d6b7ee5517/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:49.346067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.425286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.432322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41537-2143-4309-9b92-f182a8780cf5 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.488391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962771ff-2944-4b3f-8dda-fa84bfdecb26 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.499911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.500760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.501112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.501384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.502134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.504120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.586018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 816/1609] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/projects => generated 363 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:49.586906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.596283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.596994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.597272 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.597544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.599139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.601779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f5074-fd01-4553-a432-4fce3967860b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.656855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 794/1610] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/users => generated 308 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:49.658250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17956-d346-42b3-9b3e-eb7c9731ebb0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.658539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17956-d346-42b3-9b3e-eb7c9731ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.658815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17956-d346-42b3-9b3e-eb7c9731ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.685950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1ae17956-d346-42b3-9b3e-eb7c9731ebb0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:49.687416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1ae17956-d346-42b3-9b3e-eb7c9731ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.736908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6733cd-2ace-42ee-8a71-f818fa6fdae5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.748189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.751715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.752283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.752662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.754316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.758506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658cb7-30dc-4769-aea7-69fcf89ef683 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.785739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 817/1611] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:49.789305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.789597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.789874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.823092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 795/1612] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:49.826513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.826813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.827197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.847816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] MFA Rules not processed for user `99e2385751784d2d9f906fac039ab5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:49.849070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.882197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:49.883781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.895907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 796/1613] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:49.897020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.925879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9043853-15e0-40c3-abee-32a3351b4b83 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.937606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.938958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.939614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.940604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.945695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.025562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.025562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.027238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 818/1614] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:50.027238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.027238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2e15e-0aaa-42c1-98ab-41bc7f276087 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.027238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.027687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.027687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.027687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.027687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.027687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.028171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 797/1615] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:50.028171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.028358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 819/1616] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:50.028358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.040516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ad84-1f10-41e3-9edb-e2cd731a3d6a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.048438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.050621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.051172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.051710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] PATH_INFO: `/v3/projects/c26e9bb1be1a4d8ab7d875a49fe9f0d5/users/eafb96a2051e44b6a0cc88204a632998/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.077879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.092293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26e9bb1be1a4d8ab7d875a49fe9f0d5, user_id=eafb96a2051e44b6a0cc88204a632998, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.094994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.112738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cb388-9fa5-40a6-af39-eb5bd12a4190 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.122170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 798/1617] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:50 2022] PUT /identity/v3/projects/c26e9bb1be1a4d8ab7d875a49fe9f0d5/users/eafb96a2051e44b6a0cc88204a632998/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:50.123062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.206767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592450-2f41-423c-9008-0472948881cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.207458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592450-2f41-423c-9008-0472948881cf service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.207747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592450-2f41-423c-9008-0472948881cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.208067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592450-2f41-423c-9008-0472948881cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.243813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415156d-7e18-4056-aeb8-2c9aa46baae6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.252182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.253097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.253381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.255565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.327677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592450-2f41-423c-9008-0472948881cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.334625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592450-2f41-423c-9008-0472948881cf service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.354693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 820/1618] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:50.355606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592450-2f41-423c-9008-0472948881cf service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.360662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.362947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.375603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 799/1619] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:50.376594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.387525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871097-b45d-45a2-91cc-5fc4b90be4b6 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.399674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.400589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.400757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.401000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.401750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.408706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.427022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 800/1620] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:50.427022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.436066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592450-2f41-423c-9008-0472948881cf service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.438267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de956-c868-4440-868d-4274b32c18a6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.442270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.443168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.443588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.443982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.444916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.446061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.446697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.447115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] PATH_INFO: `/v3/projects/f8f01573cb624e8c86c91c07bb29d04e/users/b4ed6bdfd5754335bcfb3a1dd3985f08/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.486101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f01573cb624e8c86c91c07bb29d04e, user_id=b4ed6bdfd5754335bcfb3a1dd3985f08, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.490621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0d26-9552-44c6-8c31-946d722d709c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.514905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 801/1621] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:50 2022] PUT /identity/v3/projects/f8f01573cb624e8c86c91c07bb29d04e/users/b4ed6bdfd5754335bcfb3a1dd3985f08/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:50.519648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.520056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.520671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.533272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.539869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.542407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.555481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] MFA Rules not processed for user `eafb96a2051e44b6a0cc88204a632998`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:50.557124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.559489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 821/1622] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:50.560693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.585894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b492ae-a283-412e-b5aa-5ac7aca7f9ec service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.626712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.713713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.715463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.715763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.716043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] PATH_INFO: `/v3/projects/59375e65456a4000b14be66404296c44/users/a9e3d5cef71e447c97a2f3355674ba08/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.727208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 802/1623] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:50.728224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.747514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0de07-e671-4548-aba1-a370659eb0ad None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.750255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59375e65456a4000b14be66404296c44, user_id=a9e3d5cef71e447c97a2f3355674ba08, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.758261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.759528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.762912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.764135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.764642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.768535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.773452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.794820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 822/1624] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:50 2022] PUT /identity/v3/projects/59375e65456a4000b14be66404296c44/users/a9e3d5cef71e447c97a2f3355674ba08/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:50.797637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.806865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 803/1625] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:50.808602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.832206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fdb14-3b14-4659-8a27-04e71246f749 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.018857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b89be-6a8c-47fb-8a40-9cdb705bf9c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.045919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.046992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.047731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.048014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.048144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.048286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.049109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.049778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.050382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.051826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.054002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.058541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.085784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 804/1626] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:51.086089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.109100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1b2c-9dc9-4ac8-b061-8317d8bdf2b5 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.125170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.126446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.128904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.129618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 823/1627] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:50 2022] POST /identity/v3/projects => generated 377 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:51.130777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] PATH_INFO: `/v3/projects/f8f01573cb624e8c86c91c07bb29d04e/users/b4ed6bdfd5754335bcfb3a1dd3985f08/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.135750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.135944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f01573cb624e8c86c91c07bb29d04e, user_id=b4ed6bdfd5754335bcfb3a1dd3985f08, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.141951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.176482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 805/1628] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:51 2022] PUT /identity/v3/projects/f8f01573cb624e8c86c91c07bb29d04e/users/b4ed6bdfd5754335bcfb3a1dd3985f08/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:51.177569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.362778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdd08e-0121-410d-914b-60ded425f093 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.369529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1b66-e596-48a5-802e-ad19b1922d3e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.375648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.377286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.377652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.378217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.379249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.379249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.379532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] PATH_INFO: `/v3/projects/59375e65456a4000b14be66404296c44/users/a9e3d5cef71e447c97a2f3355674ba08/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.379950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.381154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.383355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255ec2-d7e3-41dc-b014-e5c71ba168a2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.385145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59375e65456a4000b14be66404296c44, user_id=a9e3d5cef71e447c97a2f3355674ba08, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.390312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.400870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:51.413405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 806/1629] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:51.415335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de350-0e5c-42b7-9c0e-a0d03d6f92f3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.415844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de350-0e5c-42b7-9c0e-a0d03d6f92f3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.416315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de350-0e5c-42b7-9c0e-a0d03d6f92f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.430524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 824/1630] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:51 2022] PUT /identity/v3/projects/59375e65456a4000b14be66404296c44/users/a9e3d5cef71e447c97a2f3355674ba08/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:51.431549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.460144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b33de350-0e5c-42b7-9c0e-a0d03d6f92f3 None None] MFA Rules not processed for user `b4ed6bdfd5754335bcfb3a1dd3985f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:51.463355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b33de350-0e5c-42b7-9c0e-a0d03d6f92f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.496239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:51.610508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 807/1631] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:51.612486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.612871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.613297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.629156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f96e9-564e-4253-9980-118e681a3f59 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.648113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.648955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.649162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.649433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.650180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.658537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.701381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] MFA Rules not processed for user `a9e3d5cef71e447c97a2f3355674ba08`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:51.735845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.741679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 825/1632] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:51.743635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.892944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15eb0c-d7ee-4d3d-b9cc-fa8acce43e51 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.898917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.899962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.900476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.900684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.917144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.918882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.934139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 826/1633] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:51.936118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.979110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da17-b7be-47a1-9c76-33da3c3955d0 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.984895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.986492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.986892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.988459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] PATH_INFO: `/v3/projects/f646f50eebae4baca5a96a738efdbca6/users/f39c3bdea4ef46868836f835f41a5299/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.022360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f646f50eebae4baca5a96a738efdbca6, user_id=f39c3bdea4ef46868836f835f41a5299, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.025262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.069012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 808/1634] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:52.071450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.079636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 827/1635] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:51 2022] PUT /identity/v3/projects/f646f50eebae4baca5a96a738efdbca6/users/f39c3bdea4ef46868836f835f41a5299/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:52.083078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.098831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa87f-60f5-4de9-91df-9d7ab94c89c9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.212842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d53a-8794-4dd5-ae0e-00f5b011d0c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.218514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.220232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.220792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.221839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.266583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.275759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.279166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.279413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.279694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.280520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.285042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.319623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 809/1636] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:52.324135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.340687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.342324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887b93b-2ea5-42b3-98c9-80d798d555e9 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.351837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0357-a1a1-4bfe-a3a7-4fd996c3b59b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.365454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 828/1637] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:52.387794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.390342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.398102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.398526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] PATH_INFO: `/v3/projects/f646f50eebae4baca5a96a738efdbca6/users/f39c3bdea4ef46868836f835f41a5299/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.401402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f646f50eebae4baca5a96a738efdbca6, user_id=f39c3bdea4ef46868836f835f41a5299, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.404990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.435042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 810/1638] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:52 2022] PUT /identity/v3/projects/f646f50eebae4baca5a96a738efdbca6/users/f39c3bdea4ef46868836f835f41a5299/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:52.447379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.447758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.447959 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.497236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.517935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] MFA Rules not processed for user `f39c3bdea4ef46868836f835f41a5299`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:52.519476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:52.600126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.741661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9d54-dab8-4c78-a6f8-45ea4ab9641a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.768666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.769825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.770107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.771283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] PATH_INFO: `/v3/users/fb948dd3d4f446c29f6e4a1606033fe9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.775590 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb948dd3d4f446c29f6e4a1606033fe9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.779530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.856694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 829/1639] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:52.867751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.912677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb948dd3d4f446c29f6e4a1606033fe9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.930249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb948dd3d4f446c29f6e4a1606033fe9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.949042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb948dd3d4f446c29f6e4a1606033fe9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.949665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb948dd3d4f446c29f6e4a1606033fe9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.950303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-70dd6269-2812-4c2d-aa9a-ab4e577495e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb948dd3d4f446c29f6e4a1606033fe9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.986855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb6b57-1245-4052-a8ea-e30d8912d73e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.994064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.995011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 811/1640] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:52 2022] DELETE /identity/v3/users/fb948dd3d4f446c29f6e4a1606033fe9 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:52.995154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.995482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.995764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.997955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:52.999451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.999675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.999956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.044354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.045607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.161330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 812/1641] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.162438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.165509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687764b-63eb-4f7d-84c4-993c7d5c77bd service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.180993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:53.188275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 830/1642] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:53.195027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.197527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.290954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:53.324970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b8ef3-b7c7-4e7d-9b4d-c9146bd6313d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.335894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.337724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.338005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.340361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.375466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.377647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3e2a-73bb-4510-961a-8cc3cd23ba39 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.391036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 813/1643] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:53.457652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.458215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.459427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.461202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 831/1644] 10.222.0.82 () {54 vars in 962 bytes} [Wed Jul 20 19:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:24:53.481630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da8ed-b937-44de-b310-f003f1228cf7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.482430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da8ed-b937-44de-b310-f003f1228cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.482944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da8ed-b937-44de-b310-f003f1228cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.605263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.607825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.609278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d43da8ed-b937-44de-b310-f003f1228cf7 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.614824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d43da8ed-b937-44de-b310-f003f1228cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.657468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14920a-00d2-4375-a97d-084d94eb3d55 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.684010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.694882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.695147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.695466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] PATH_INFO: `/v3/users/8ad4132ff66046c89c388e48922ba8f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.699989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad4132ff66046c89c388e48922ba8f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.701088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: WARNING py.warnings [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:53.701088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: warnings.warn(msg) Jul 20 19:24:53.701088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: Jul 20 19:24:53.702286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.830655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 814/1645] 10.222.0.82 () {58 vars in 1059 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.838181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edcd1-27ac-4e56-9657-d680d6fc808c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.838706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edcd1-27ac-4e56-9657-d680d6fc808c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.839177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edcd1-27ac-4e56-9657-d680d6fc808c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.843062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 815/1646] 10.222.0.82 () {54 vars in 912 bytes} [Wed Jul 20 19:24:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:53.853012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.853544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.854017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.897203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.897203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.919956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 816/1647] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.928746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.930493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.961456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad4132ff66046c89c388e48922ba8f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:53.992306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad4132ff66046c89c388e48922ba8f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.062996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad4132ff66046c89c388e48922ba8f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.065527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad4132ff66046c89c388e48922ba8f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.086642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39981-f100-4bd8-bfcc-56f00347d4ea None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.098426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.099387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.099705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.099939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.104171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e523535e-92a3-4767-808e-211315b2e13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad4132ff66046c89c388e48922ba8f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.108334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.121184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 832/1648] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:53 2022] DELETE /identity/v3/users/8ad4132ff66046c89c388e48922ba8f5 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:54.125690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c167da6-45f8-47fb-bdb6-9b0e533dbf0d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.125983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c167da6-45f8-47fb-bdb6-9b0e533dbf0d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.126264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c167da6-45f8-47fb-bdb6-9b0e533dbf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.146229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.149110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.156914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9c167da6-45f8-47fb-bdb6-9b0e533dbf0d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:54.167221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9c167da6-45f8-47fb-bdb6-9b0e533dbf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.185863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 817/1649] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:54.395883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 833/1650] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:54.437725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.439501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.466465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469aff-2824-4de9-a4cf-b1b8d2b160b7 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.623987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.623987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.623987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.623987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.647021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.650018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.672629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 818/1651] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:55.633876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875247-625d-40d2-88d1-2ecc83b5e69c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.633876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875247-625d-40d2-88d1-2ecc83b5e69c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.633876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875247-625d-40d2-88d1-2ecc83b5e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.689850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.692354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.712219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:55.726955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-30875247-625d-40d2-88d1-2ecc83b5e69c None None] MFA Rules not processed for user `098429887fdb41ddb00c7a50cc5d54fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.727096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641fc4-5039-4dbe-b857-36d4aa899b55 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.728627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-30875247-625d-40d2-88d1-2ecc83b5e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.753039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.753967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.754247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.754519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] PATH_INFO: `/v3/projects/4485e390473a464e904a1e5ac9525778` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.760038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4485e390473a464e904a1e5ac9525778)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.765053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: WARNING py.warnings [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:55.765053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: warnings.warn(msg) Jul 20 19:24:55.765053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: Jul 20 19:24:55.769010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.913833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 834/1652] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.919131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812805-4a43-4dce-ae76-6666745f88e1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.919502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812805-4a43-4dce-ae76-6666745f88e1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.919786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812805-4a43-4dce-ae76-6666745f88e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.936387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:55.965603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9d812805-4a43-4dce-ae76-6666745f88e1 None None] MFA Rules not processed for user `098429887fdb41ddb00c7a50cc5d54fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.966995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9d812805-4a43-4dce-ae76-6666745f88e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.999268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4485e390473a464e904a1e5ac9525778', 'request_id': 'req-25a3a6b4-5c52-4340-bcaa-534de08e3df2'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.039051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4485e390473a464e904a1e5ac9525778', 'request_id': 'req-25a3a6b4-5c52-4340-bcaa-534de08e3df2'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.056904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4485e390473a464e904a1e5ac9525778', 'request_id': 'req-25a3a6b4-5c52-4340-bcaa-534de08e3df2'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.087000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] The token cache is being invalidate because project 4485e390473a464e904a1e5ac9525778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:56.087708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.089503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.092361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 819/1653] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:55 2022] DELETE /identity/v3/projects/4485e390473a464e904a1e5ac9525778 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:56.097444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.100051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.188852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 835/1654] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:56.256136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe53b6a-f4c8-4165-aa91-718d776eadd6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.256501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe53b6a-f4c8-4165-aa91-718d776eadd6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.256708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe53b6a-f4c8-4165-aa91-718d776eadd6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.263441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 836/1655] 10.222.0.82 () {54 vars in 962 bytes} [Wed Jul 20 19:24:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:56.296338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.296976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.297412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.351089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:56.358605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.401701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3a6b4-5c52-4340-bcaa-534de08e3df2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.420041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.426745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.427088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.427335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] PATH_INFO: `/v3/users/a9e3d5cef71e447c97a2f3355674ba08` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.431940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e3d5cef71e447c97a2f3355674ba08)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.438923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.565242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e3d5cef71e447c97a2f3355674ba08'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.597780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e3d5cef71e447c97a2f3355674ba08'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.614973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 837/1656] 10.222.0.82 () {58 vars in 1059 bytes} [Wed Jul 20 19:24:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:56.616853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.635359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.642252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e3d5cef71e447c97a2f3355674ba08'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.649402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e3d5cef71e447c97a2f3355674ba08'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.651260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e3d5cef71e447c97a2f3355674ba08'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.675002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e4693-5524-419c-ac0e-b18a6304ec61 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.687933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.690159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.690693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.695490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 820/1657] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:56 2022] DELETE /identity/v3/users/a9e3d5cef71e447c97a2f3355674ba08 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:56.695922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] PATH_INFO: `/v3/projects/3b9e0e5b42524acbb1a493afec2f7b5d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.696379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.696464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9e0e5b42524acbb1a493afec2f7b5d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.696859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.699798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.739917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:56.890508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9e0e5b42524acbb1a493afec2f7b5d', 'request_id': 'req-07d40929-c1f1-466a-8fa7-afadecbf3a7e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.912675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82526de-1b5b-4887-a05e-aa37086cf60a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.914510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9e0e5b42524acbb1a493afec2f7b5d', 'request_id': 'req-07d40929-c1f1-466a-8fa7-afadecbf3a7e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.932943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9e0e5b42524acbb1a493afec2f7b5d', 'request_id': 'req-07d40929-c1f1-466a-8fa7-afadecbf3a7e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.974671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] The token cache is being invalidate because project 3b9e0e5b42524acbb1a493afec2f7b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:56.974983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.976104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:56.977806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 838/1658] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:56 2022] DELETE /identity/v3/projects/3b9e0e5b42524acbb1a493afec2f7b5d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:56.982777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.987010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.052754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:57.055226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.056116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.056854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.063041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:57.079509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.238231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d40929-c1f1-466a-8fa7-afadecbf3a7e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:57.254292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:57.257778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.260221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.260808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] PATH_INFO: `/v3/users/b4ed6bdfd5754335bcfb3a1dd3985f08` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.266230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ed6bdfd5754335bcfb3a1dd3985f08)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:57.286435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:57.315536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:57.318471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:57.349846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 821/1659] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:57.401604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ed6bdfd5754335bcfb3a1dd3985f08'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:57.413278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ed6bdfd5754335bcfb3a1dd3985f08'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:57.431473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ed6bdfd5754335bcfb3a1dd3985f08'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:57.432611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ed6bdfd5754335bcfb3a1dd3985f08'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:57.442285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-415b309e-19a9-4438-aeff-f722ecddea7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ed6bdfd5754335bcfb3a1dd3985f08'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:57.449550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 839/1660] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:56 2022] DELETE /identity/v3/users/b4ed6bdfd5754335bcfb3a1dd3985f08 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:57.504328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:57.507039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.611733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:57.636246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1be1f-f21f-4e4f-a034-f4936d962199 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:57.747598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:57.749659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.750070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.751568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.754312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.888263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:57.890056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5b16f-4049-4b04-ba06-3f2f048afab4 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:57.914582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 822/1661] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:57.951216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.951782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.952061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.953664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 840/1662] 10.222.0.82 () {54 vars in 912 bytes} [Wed Jul 20 19:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:57.963482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.963851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.964242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.997777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:58.001272 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.015190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.018006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.170365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 823/1663] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:58.185146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.186804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.190530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db4bae-8f2d-482b-bee3-cd7ed2b72840 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.199682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.200581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.200855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.201127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] PATH_INFO: `/v3/projects/59375e65456a4000b14be66404296c44` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.202520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59375e65456a4000b14be66404296c44)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.205106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.244878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:58.311481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:58.321525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59375e65456a4000b14be66404296c44', 'request_id': 'req-8147e469-9aab-4b75-bac1-cf802e1ca928'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:58.333694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fac0c4-c28b-4758-a2df-aa5ee0dbbf91 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.342423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59375e65456a4000b14be66404296c44', 'request_id': 'req-8147e469-9aab-4b75-bac1-cf802e1ca928'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:58.360933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59375e65456a4000b14be66404296c44', 'request_id': 'req-8147e469-9aab-4b75-bac1-cf802e1ca928'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:58.378669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] The token cache is being invalidate because project 59375e65456a4000b14be66404296c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:58.379740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:58.384384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8147e469-9aab-4b75-bac1-cf802e1ca928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:58.389670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 841/1664] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:58 2022] DELETE /identity/v3/projects/59375e65456a4000b14be66404296c44 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:58.391606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881af2-d9e3-414f-97ec-68a2d7f3c13b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.391919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881af2-d9e3-414f-97ec-68a2d7f3c13b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.392272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881af2-d9e3-414f-97ec-68a2d7f3c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.453342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-91881af2-d9e3-414f-97ec-68a2d7f3c13b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:58.454693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-91881af2-d9e3-414f-97ec-68a2d7f3c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.501867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.503281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.503619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.503898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.512135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.607156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 842/1665] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:58.615283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.615630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.616053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.669689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:58.674005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.714587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 843/1666] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:58.715737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.749443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd18cc9-4fc2-4737-9b67-30c77c226e5a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.768573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.769423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.769717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.770851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.773250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:58.773522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.776812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.792244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.794834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.812163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 844/1667] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:58.815020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.839407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 824/1668] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:58.853264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b215f1-ea52-49b7-abc9-d5f55d122e55 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.867726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.871679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.871996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.877032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.878077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.880538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.957600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 845/1669] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:58 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:58.959024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.976074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451073b9-5afe-46a8-ab28-9b9d6f51b0c2 service glance] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.112705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.113514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.113870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.114212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.114998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.117077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.167748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 825/1670] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:58 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:59.169157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.183929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d797-a81b-4101-88bf-5bfaa9a77583 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.217612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.219660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.221442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.221911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.222893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.226313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.253063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 846/1671] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:59.254711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.269212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a338-3125-4da5-9854-6fb0ca48dcfe admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.286869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.288093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.288491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.288950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.289884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.291930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cca29-9835-438b-8cd8-bc147e4f44fb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.293736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:59.315046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 826/1672] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:59.318913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.332918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963fed-489f-4613-b5d5-fd8bfe7e9186 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.350044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.351197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.351632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.352004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] PATH_INFO: `/v3/projects/8737156d566e49fca8aafc5e15134ca7/users/b119b7db8e634759996c4e2fa10b4c0c/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.402781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8737156d566e49fca8aafc5e15134ca7, user_id=b119b7db8e634759996c4e2fa10b4c0c, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.408756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.457843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.458132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.458412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.469599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 847/1673] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:59 2022] PUT /identity/v3/projects/8737156d566e49fca8aafc5e15134ca7/users/b119b7db8e634759996c4e2fa10b4c0c/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:59.489278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] MFA Rules not processed for user `b119b7db8e634759996c4e2fa10b4c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:59.491016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:59.590664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 827/1674] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:59.595091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.840668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.842292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:59.846174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:59.867789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8f14-d416-41fd-ba3f-798c0a58a3e4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.879369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90482-61f0-4977-8a24-38ae1f287820 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.894447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.895329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.895636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.895909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.896629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.899914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.901056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.901511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.901654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690e11c-d7cb-4cc9-a625-ea80ec43c348 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.902714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] PATH_INFO: `/v3/projects/f8f01573cb624e8c86c91c07bb29d04e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.905823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f01573cb624e8c86c91c07bb29d04e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.914738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.009450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 848/1675] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:59 2022] POST /identity/v3/projects => generated 365 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:00.014695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0f13-a79c-4e0d-8bd8-5637a3ef9c10 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.015551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0f13-a79c-4e0d-8bd8-5637a3ef9c10 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.016170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0f13-a79c-4e0d-8bd8-5637a3ef9c10 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.018518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 849/1676] 10.222.0.82 () {54 vars in 912 bytes} [Wed Jul 20 19:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:00.019632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0f13-a79c-4e0d-8bd8-5637a3ef9c10 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.110252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f01573cb624e8c86c91c07bb29d04e', 'request_id': 'req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:00.127807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f01573cb624e8c86c91c07bb29d04e', 'request_id': 'req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:00.151762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f01573cb624e8c86c91c07bb29d04e', 'request_id': 'req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:00.186563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0f13-a79c-4e0d-8bd8-5637a3ef9c10 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.187292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] The token cache is being invalidate because project f8f01573cb624e8c86c91c07bb29d04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:00.187753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:00.190530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6a9e33bf-ac7e-4fce-94c3-fa3d5d7d01b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:00.193007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 828/1677] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:59 2022] DELETE /identity/v3/projects/f8f01573cb624e8c86c91c07bb29d04e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:00.194520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.194921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.199698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.308447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:00.311919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.332113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.332828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.333149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.333421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.334259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.360414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934787-a8d1-4375-93e6-3663b65620e5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.399152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 850/1678] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/users => generated 289 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:00.406805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea2de8-4e4d-4ae2-a258-d39d4e72e98d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.407094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea2de8-4e4d-4ae2-a258-d39d4e72e98d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.407390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea2de8-4e4d-4ae2-a258-d39d4e72e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.458489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 829/1679] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:00.460081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1fea2de8-4e4d-4ae2-a258-d39d4e72e98d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:00.460980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.462308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1fea2de8-4e4d-4ae2-a258-d39d4e72e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.463869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.492401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 851/1680] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:00.493944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.494235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.494508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.500100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:00.515386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961fb95-8a37-4126-b9f3-9a98ec7508dd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.526898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.527841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.528245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.528638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.529540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.532278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.552432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:00.557317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.564688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 830/1681] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:00.566351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.590641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 852/1682] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:00.593342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542722e-03be-4f38-9ad3-92fd0da54d1a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.597361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.609672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.611205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.611627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.612006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] PATH_INFO: `/v3/projects/f007081f084a46779122593d188dadbc/users/3364961661e8404fb2dd71743887dec0/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.623720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad702d-840b-4ac4-9aeb-08bfab6faec7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.636781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.637475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.637770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.638027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.643259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:00.644800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.646859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.679941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f007081f084a46779122593d188dadbc, user_id=3364961661e8404fb2dd71743887dec0, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.682878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.687281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 853/1683] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:00.688402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.690534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.710600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebe11-f434-40c6-b9f4-19f7bd4f5044 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.725231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 831/1684] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:00 2022] PUT /identity/v3/projects/f007081f084a46779122593d188dadbc/users/3364961661e8404fb2dd71743887dec0/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:00.726449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.938759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.940964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.942341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.942716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.958010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:00.972485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b32d-a735-4d57-81a9-768489825e0b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.975427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.977017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.992662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.993458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.993847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.994235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.995071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.006798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.022172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 854/1685] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:01.023573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:01.045716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8243fa-4274-484c-8e10-f13b71b6f2e7 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.056056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.057832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.059765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.060388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.061052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.063050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.087832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 855/1686] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:01.089840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:01.114375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd9792-ab0d-4b68-902f-8a1fb3558c0f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.116752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 832/1687] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/projects => generated 369 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:01.121013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:01.285653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.286755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.286934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.287210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] PATH_INFO: `/v3/projects/f007081f084a46779122593d188dadbc/users/3364961661e8404fb2dd71743887dec0/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.289558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f007081f084a46779122593d188dadbc, user_id=3364961661e8404fb2dd71743887dec0, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.292498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb7d6f-ea55-4f62-9a9b-7c1c1118e83b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.321861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 856/1688] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:01 2022] PUT /identity/v3/projects/f007081f084a46779122593d188dadbc/users/3364961661e8404fb2dd71743887dec0/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:01.333564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.333564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.333564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.461376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] MFA Rules not processed for user `3364961661e8404fb2dd71743887dec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:01.473531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:01.625586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14e206-36a7-443f-af23-797abeb5ed60 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.665248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 857/1689] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:01.674861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:01.677324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:01.860193 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b7a9-667a-49da-b080-2c6adbdd50db None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.874196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.874967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.875276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.875597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.889672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.892499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.896471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.898899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.901304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.903072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.904009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.909145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.913627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 858/1690] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:01.958952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:01.997938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 833/1691] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:01 2022] POST /identity/v3/users => generated 285 bytes in 878 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:02.001907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:02.010566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:02.045673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa38f-ae44-4b98-9d41-e8a60fe96216 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:02.070831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:02.071708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.072613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.074627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.078673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:02.085306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:02.137248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 859/1692] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:02.141401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:02.158695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ff2f-49ee-4fad-bd28-884e539f2a19 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:02.190264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:02.193330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.193649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.193891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.199678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:02.208243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:02.225015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:02.227345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:02.251530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 834/1693] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:02.255316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9af1a-ea8b-4f36-9ae5-8681f180bd25 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:02.255539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:02.266648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:02.267431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.267719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.268088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.288384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:02.288610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fde67d-7662-40ad-b6bd-8086fb984c18 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:02.302898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:02.304098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.304490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.304765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] PATH_INFO: `/v3/projects/6e1e4b9da83a470985ba3cc740284514/users/2b9985d8b108499abc5cf8814d3663c5/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.350043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1e4b9da83a470985ba3cc740284514, user_id=2b9985d8b108499abc5cf8814d3663c5, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:02.358746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9149d9-3619-4c8d-8bf9-341ed60dfc57 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:02.411424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 835/1694] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:02 2022] PUT /identity/v3/projects/6e1e4b9da83a470985ba3cc740284514/users/2b9985d8b108499abc5cf8814d3663c5/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:02.426688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.426981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.435864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.494463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:02.500335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:02.524650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 860/1695] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:02.549950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] MFA Rules not processed for user `2b9985d8b108499abc5cf8814d3663c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:02.551432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:02.771936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 836/1696] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:02.773458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:02.790665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ada5f-ddc2-477e-929e-21a219fb95e4 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:02.972985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:02.973776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.974101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.976274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.977046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:02.984909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.067588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 861/1697] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:02 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:03.071978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.090481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9747b-daba-4ef1-8da2-321ed4b2e52c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.220572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.221548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.221985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.222380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.223766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.226047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.279756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 837/1698] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:03 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:03.283739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.311119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df437c5-0513-466e-9133-24f1521d70af admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.330393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.334465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.334965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.335393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.338084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.343236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a778-4779-496a-879a-5dbda1c18f25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.387364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 862/1699] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:03.392508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.409290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097fd8-952e-4ba6-8169-8763d78e838b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.428121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.429442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.430362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.431664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] PATH_INFO: `/v3/projects/6af2c561f96b4bb18e9adc81592e9f94/users/255b941d7c984561b08adc5ac7fd957a/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.502726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af2c561f96b4bb18e9adc81592e9f94, user_id=255b941d7c984561b08adc5ac7fd957a, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.515159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb2373-9ff0-4d2c-86e8-08d50633b235 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.553998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784c3-f835-4219-8561-c6016cb41022 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.553998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784c3-f835-4219-8561-c6016cb41022 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.553998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784c3-f835-4219-8561-c6016cb41022 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.556730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 863/1701] 10.222.0.82 () {54 vars in 961 bytes} [Wed Jul 20 19:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:03.556730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e784c3-f835-4219-8561-c6016cb41022 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.561602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 838/1701] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:03 2022] PUT /identity/v3/projects/6af2c561f96b4bb18e9adc81592e9f94/users/255b941d7c984561b08adc5ac7fd957a/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:03.571595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616dc16-445e-41c3-9965-7d219a5bab8d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.571908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616dc16-445e-41c3-9965-7d219a5bab8d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.572186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616dc16-445e-41c3-9965-7d219a5bab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.694776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b616dc16-445e-41c3-9965-7d219a5bab8d None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:03.702545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b616dc16-445e-41c3-9965-7d219a5bab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:03.735641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:03.867372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e784c3-f835-4219-8561-c6016cb41022 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.882445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.883852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.888060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.888363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.889448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.897536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.937065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 864/1702] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:03.943048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.950143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:03.955662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786f00-88de-4147-95b4-cb446e4b62e0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.965731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.968397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.968701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.969126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] PATH_INFO: `/v3/projects/6af2c561f96b4bb18e9adc81592e9f94/users/255b941d7c984561b08adc5ac7fd957a/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.972125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af2c561f96b4bb18e9adc81592e9f94, user_id=255b941d7c984561b08adc5ac7fd957a, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.982029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a180c89-892c-4c6e-93b7-658c16706e9e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:04.028520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 865/1703] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:03 2022] PUT /identity/v3/projects/6af2c561f96b4bb18e9adc81592e9f94/users/255b941d7c984561b08adc5ac7fd957a/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:04.032942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.033601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.034050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.076334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] MFA Rules not processed for user `255b941d7c984561b08adc5ac7fd957a`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:04.078104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.091208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 839/1704] 10.222.0.82 () {58 vars in 1058 bytes} [Wed Jul 20 19:25:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.095820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.096302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.096773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.156109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] MFA Rules not processed for user `098429887fdb41ddb00c7a50cc5d54fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:04.159794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.352460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 866/1705] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.353602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.363740 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 840/1706] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.364675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.505644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131fa4-447c-43b0-8b62-f888a6fd47b6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:04.526756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:04.527630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.529073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.529548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.537105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.565701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580668-7fd2-4fe2-a338-b4c3c526aaee None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:04.577951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:04.578833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.579129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.579589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.582323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:04.584491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df74da-c29d-4ad3-a504-37c2f689e305 service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:04.604991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:04.606797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:04.621800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 867/1707] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:04.623457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.623813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.624159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.634640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 841/1708] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:04.689734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] MFA Rules not processed for user `048ff38a084747338fb6d69ed0ab9644`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:04.691628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.865425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:04.895790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 868/1709] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.913996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.922392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:05.129248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:05.213088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3144e2-83bd-4fbb-9d09-27e81f51da43 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.230420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.231111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.231421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.231701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.269707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.271634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e3106-8a28-4d48-9f1a-023f0e37d700 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.312785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 842/1710] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:05.360490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:05.362459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:05.653936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320bb6-53c8-4c0c-8ab4-638819d3f8c3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.676527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.676760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.677078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.677619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] PATH_INFO: `/v3/users/99e2385751784d2d9f906fac039ab5ab` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.680086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e2385751784d2d9f906fac039ab5ab)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.683653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.816058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e2385751784d2d9f906fac039ab5ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:05.835585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e2385751784d2d9f906fac039ab5ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:05.891803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e2385751784d2d9f906fac039ab5ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:05.894459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e2385751784d2d9f906fac039ab5ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:05.949407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e2385751784d2d9f906fac039ab5ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.005499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 869/1711] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:05 2022] DELETE /identity/v3/users/99e2385751784d2d9f906fac039ab5ab => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:06.010085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.010490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.010982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.047669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.053700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.066929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:06.071478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.334041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 843/1712] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:06.383369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.384926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.394111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ba43-2f5d-423e-af90-08854686ee03 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.420112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:06.421127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.421406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.421686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] PATH_INFO: `/v3/users/b119b7db8e634759996c4e2fa10b4c0c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.425281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b119b7db8e634759996c4e2fa10b4c0c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:06.427285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:06.428383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab563bc-faf2-475b-af1b-4dda0270ae2d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.448921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:06.450121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.450615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.451649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] PATH_INFO: `/v3/users/2b9985d8b108499abc5cf8814d3663c5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.458172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9985d8b108499abc5cf8814d3663c5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:06.461328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:06.510771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:06.606377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9985d8b108499abc5cf8814d3663c5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.635183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9985d8b108499abc5cf8814d3663c5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.636664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b119b7db8e634759996c4e2fa10b4c0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.662932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9985d8b108499abc5cf8814d3663c5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.663098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b119b7db8e634759996c4e2fa10b4c0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.665181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9985d8b108499abc5cf8814d3663c5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.668460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c246cc55-295c-489b-8d1b-cc5593f7a3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9985d8b108499abc5cf8814d3663c5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.702445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b119b7db8e634759996c4e2fa10b4c0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.704906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b119b7db8e634759996c4e2fa10b4c0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.723486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b119b7db8e634759996c4e2fa10b4c0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.739816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 870/1713] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:06 2022] DELETE /identity/v3/users/b119b7db8e634759996c4e2fa10b4c0c => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:06.742478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.747062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 844/1714] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:06 2022] DELETE /identity/v3/users/2b9985d8b108499abc5cf8814d3663c5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:06.747702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.749234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ab145-d48f-4e43-bdec-cc8c9036102f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.749595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ab145-d48f-4e43-bdec-cc8c9036102f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.749957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ab145-d48f-4e43-bdec-cc8c9036102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.808106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-701ab145-d48f-4e43-bdec-cc8c9036102f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:06.810198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-701ab145-d48f-4e43-bdec-cc8c9036102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.971582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a4fb-463c-4626-bc09-3e232a9232bf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.996280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:07.046931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 845/1715] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:07.051272 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.051873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.052316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.113614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:07.115578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.137546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 846/1716] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:07.138835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:07.145033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.185283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:07.188907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.200144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.207567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.215666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.250874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:07.252665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:07.278823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 871/1717] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:07.280655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:07.287909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.326310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f7bd-25a5-4879-b17e-df2c832d763c service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:07.334989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:07.335737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.336022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.336302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.342090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad157c3-0fb2-4127-ac1c-51f192559678 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:07.347261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:07.348361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.349027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.349455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.367088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:07.368252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:07.371348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:07.372496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ddced-0a9a-4bf6-8429-dd08dcc84558 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:07.399548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 847/1718] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:07.404143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 872/1719] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:08.929306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:08.929813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:08.930001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:09.154672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:09.161139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:09.494180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:09.498198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 848/1720] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:25:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:09.499185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:09.543121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d2e8-7b8e-436f-b64c-13004ed8dfd8 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:09.552397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:09.553554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:09.554314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:09.554766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] PATH_INFO: `/v3/projects/8737156d566e49fca8aafc5e15134ca7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:09.556339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8737156d566e49fca8aafc5e15134ca7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:09.558684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:09.633644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:09.684651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8737156d566e49fca8aafc5e15134ca7', 'request_id': 'req-924bcca6-a458-4bb7-9ec2-787c5fae9f04'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:09.698202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:09.703376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:09.705272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8737156d566e49fca8aafc5e15134ca7', 'request_id': 'req-924bcca6-a458-4bb7-9ec2-787c5fae9f04'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:09.724061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8737156d566e49fca8aafc5e15134ca7', 'request_id': 'req-924bcca6-a458-4bb7-9ec2-787c5fae9f04'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:09.736807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] The token cache is being invalidate because project 8737156d566e49fca8aafc5e15134ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:09.737344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:09.738445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:09.757657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fceb5-f6fb-48c1-a3f2-f416de9c4404 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:09.757765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 873/1721] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:09 2022] DELETE /identity/v3/projects/8737156d566e49fca8aafc5e15134ca7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:09.759024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:09.763161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:09.888736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:09.890529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:09.890994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:09.891399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] PATH_INFO: `/v3/projects/6e1e4b9da83a470985ba3cc740284514` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:09.893157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1e4b9da83a470985ba3cc740284514)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:09.895623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:09.901580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:09.935550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bcca6-a458-4bb7-9ec2-787c5fae9f04 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:09.941222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:09.943568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:09.947105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:09.947463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] PATH_INFO: `/v3/users/3364961661e8404fb2dd71743887dec0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:09.951398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3364961661e8404fb2dd71743887dec0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:09.951398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:10.016947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1e4b9da83a470985ba3cc740284514', 'request_id': 'req-d3984d10-2929-4c4f-bd3f-164418a54612'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.030199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1e4b9da83a470985ba3cc740284514', 'request_id': 'req-d3984d10-2929-4c4f-bd3f-164418a54612'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.048729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1e4b9da83a470985ba3cc740284514', 'request_id': 'req-d3984d10-2929-4c4f-bd3f-164418a54612'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.084561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] The token cache is being invalidate because project 6e1e4b9da83a470985ba3cc740284514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:10.085751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.087852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.096521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 849/1722] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:09 2022] DELETE /identity/v3/projects/6e1e4b9da83a470985ba3cc740284514 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:10.097418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:10.098858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:10.102338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3364961661e8404fb2dd71743887dec0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.118783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3364961661e8404fb2dd71743887dec0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.145087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3364961661e8404fb2dd71743887dec0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.146102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3364961661e8404fb2dd71743887dec0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.157837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3364961661e8404fb2dd71743887dec0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.169228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 874/1723] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:09 2022] DELETE /identity/v3/users/3364961661e8404fb2dd71743887dec0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:10.174237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:10.179805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:10.254199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:10.258742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984d10-2929-4c4f-bd3f-164418a54612 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:10.293682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31682cd4-6d52-4a87-8ba9-9f735fb42ce1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:10.305424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:10.307192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:10.308066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:10.309037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] PATH_INFO: `/v3/users/255b941d7c984561b08adc5ac7fd957a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:10.310929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255b941d7c984561b08adc5ac7fd957a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:10.313524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:10.405490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255b941d7c984561b08adc5ac7fd957a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.405680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:10.406349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:10.406639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:10.407065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:10.412938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:10.416596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255b941d7c984561b08adc5ac7fd957a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.443858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255b941d7c984561b08adc5ac7fd957a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.444902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255b941d7c984561b08adc5ac7fd957a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.445039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:10.457238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255b941d7c984561b08adc5ac7fd957a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.470445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 875/1724] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:10 2022] DELETE /identity/v3/users/255b941d7c984561b08adc5ac7fd957a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:10.527397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:10.530027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9bba-a8bd-40dd-8813-5a69ffa9f553 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:10.567413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 850/1725] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:25:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:11.730912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:11.732789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:11.908609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df3a41-701c-4666-a94b-cd461e9eae56 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:11.915341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:11.916830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:11.917336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:11.917643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] PATH_INFO: `/v3/projects/398cf27d47404ad49569ea3d503fcfc1` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:11.926385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=398cf27d47404ad49569ea3d503fcfc1)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:11.932364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.082103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398cf27d47404ad49569ea3d503fcfc1', 'request_id': 'req-79975df0-9af3-444d-9613-3f928981c51e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.097038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398cf27d47404ad49569ea3d503fcfc1', 'request_id': 'req-79975df0-9af3-444d-9613-3f928981c51e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.110567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398cf27d47404ad49569ea3d503fcfc1', 'request_id': 'req-79975df0-9af3-444d-9613-3f928981c51e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.113714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:12.141549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] The token cache is being invalidate because project 398cf27d47404ad49569ea3d503fcfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:12.142287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.143461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-79975df0-9af3-444d-9613-3f928981c51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.149116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 876/1726] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:11 2022] DELETE /identity/v3/projects/398cf27d47404ad49569ea3d503fcfc1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:12.157055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.157631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.158316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.228619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:12.237758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.459770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 851/1727] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:12.462227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.462520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.462798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.507757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:12.509052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.539613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.541551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.549711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 877/1728] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:12.551463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.566670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2eb84-c0d8-4f8e-9e63-a397df498d55 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.569086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f67c5-b2bb-41af-9eba-64e8b095d56e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.580885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.581656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.582155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.582717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.583041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.583283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.583650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.583892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] PATH_INFO: `/v3/projects/f007081f084a46779122593d188dadbc` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.584313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:12.584606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.586248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.587123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f007081f084a46779122593d188dadbc)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.595130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.622083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 878/1729] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:12.625101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.657237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2a7f-b722-45b5-9612-75f14699cf99 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.685434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.686591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.689272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.689898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.691800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.722881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49567-c29a-486a-bb89-178a8ee8a2d0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.841221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f007081f084a46779122593d188dadbc', 'request_id': 'req-793c28c0-895c-47e5-997e-b489367bd557'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.866224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f007081f084a46779122593d188dadbc', 'request_id': 'req-793c28c0-895c-47e5-997e-b489367bd557'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.891139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f007081f084a46779122593d188dadbc', 'request_id': 'req-793c28c0-895c-47e5-997e-b489367bd557'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.908709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 879/1730] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/projects => generated 375 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:12.916671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682b0e6-0cd0-4d05-9c99-5f7180ed8a01 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.916898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682b0e6-0cd0-4d05-9c99-5f7180ed8a01 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.917182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682b0e6-0cd0-4d05-9c99-5f7180ed8a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.924403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] The token cache is being invalidate because project f007081f084a46779122593d188dadbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:12.925601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.927132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.930231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 852/1731] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:12 2022] DELETE /identity/v3/projects/f007081f084a46779122593d188dadbc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:12.939698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.942915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.033611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a682b0e6-0cd0-4d05-9c99-5f7180ed8a01 None None] MFA Rules not processed for user `048ff38a084747338fb6d69ed0ab9644`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.039507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a682b0e6-0cd0-4d05-9c99-5f7180ed8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.083209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:13.145854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c28c0-895c-47e5-997e-b489367bd557 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.321260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 880/1732] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:13.324772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328fbb1-928c-4311-81f1-2d7a62cd2cb8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.325091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328fbb1-928c-4311-81f1-2d7a62cd2cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.325480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328fbb1-928c-4311-81f1-2d7a62cd2cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.375982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.377711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.379428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.380368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.383651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.386214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0bae-88e1-4207-a9a6-111b439523eb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.397692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d328fbb1-928c-4311-81f1-2d7a62cd2cb8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.406447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d328fbb1-928c-4311-81f1-2d7a62cd2cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.440691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 881/1733] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:13.440691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.440691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.440691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.459379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 853/1734] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/users => generated 288 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:13.464414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.465610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.466478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.520514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.522449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.527567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.529124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.545975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 854/1735] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:13.550677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.570106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b8aaf-1401-4a32-bd9b-d603b6cabb8d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.588423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.589147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.589431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.589709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.590606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.592543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.617154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 855/1736] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:13.618466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.642585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77c0fe-75d6-4396-baf1-8398566cc024 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.658326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.659120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.659434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.659716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.660907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:13.661220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.663186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.716751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 856/1737] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:13.717633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.744221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 882/1738] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:13.745149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.750088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782e759-2462-4708-b9fb-b4bd6b01ba5a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.778784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.779535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.780021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.780262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.781612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.783548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.787398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b554-e1b9-4842-a3d4-685f62c00ee6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.805376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.806096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.806384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.806663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.807420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.809436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.826674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 857/1739] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:13.829437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.864353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebc8da-c86a-41fd-8ac5-c6f4593ffbf3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.883422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.884545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.884809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.885089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] PATH_INFO: `/v3/projects/9a0def8e293e42c5b7f93ddf4d0760ef/users/4de44609e89644c59516d9bdaf494f87/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.903319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 883/1740] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:13.911087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.923463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.947778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0def8e293e42c5b7f93ddf4d0760ef, user_id=4de44609e89644c59516d9bdaf494f87, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.950565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.995965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 858/1741] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:13 2022] PUT /identity/v3/projects/9a0def8e293e42c5b7f93ddf4d0760ef/users/4de44609e89644c59516d9bdaf494f87/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:13.997259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:14.055339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:14.111241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f465a-4a47-467b-a3dd-fc21a086ed42 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.316177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9099-19bd-4903-a8da-b9925adb9bd0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.320061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:14.322116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.322756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.323753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.367714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:14.377015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.377015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.382602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.386165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:14.391471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:14.406280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:14.430739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cae26-d0e1-4737-97b0-ba26aa9fc000 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:14.499843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 884/1742] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:14.501613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.501925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.502206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.521130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:14.557861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 859/1743] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/users => generated 294 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:14.559096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:14.634663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5088-f741-400b-90fc-18e840cd4abf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.645150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] MFA Rules not processed for user `4de44609e89644c59516d9bdaf494f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:14.646723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:14.673180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:14.674754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.675261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.675796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.689000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:14.697872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:14.746532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 860/1744] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:14.749955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:14.760097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:14.789234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62bea8-4fad-4c65-921e-0f0a8adb26eb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.805137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:14.806409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.806795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.807192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] PATH_INFO: `/v3/projects/6af2c561f96b4bb18e9adc81592e9f94` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.808760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af2c561f96b4bb18e9adc81592e9f94)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:14.811754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:14.922127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 885/1745] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:14.923107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:14.969847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af2c561f96b4bb18e9adc81592e9f94', 'request_id': 'req-af65f9a5-96f1-4682-a4dd-cf0948190381'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:14.988621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0089-c154-4611-b816-e83be55a0910 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.996401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af2c561f96b4bb18e9adc81592e9f94', 'request_id': 'req-af65f9a5-96f1-4682-a4dd-cf0948190381'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.018494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af2c561f96b4bb18e9adc81592e9f94', 'request_id': 'req-af65f9a5-96f1-4682-a4dd-cf0948190381'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.065767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] The token cache is being invalidate because project 6af2c561f96b4bb18e9adc81592e9f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:15.068134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.076522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af65f9a5-96f1-4682-a4dd-cf0948190381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.084090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 861/1746] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:14 2022] DELETE /identity/v3/projects/6af2c561f96b4bb18e9adc81592e9f94 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:15.087510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33195c-01b0-4919-bf08-1eedde84b100 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.087812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33195c-01b0-4919-bf08-1eedde84b100 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.088092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33195c-01b0-4919-bf08-1eedde84b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.141334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.143071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.143492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.145169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7e33195c-01b0-4919-bf08-1eedde84b100 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:15.145326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.145624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7e33195c-01b0-4919-bf08-1eedde84b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.146880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.148693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.179560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 886/1747] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:15.183546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.188000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.195079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 862/1748] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:15.211343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.211962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.212822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.221987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a260ba-4cdc-4fc7-b970-c997ed4779cf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.242446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.244096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.244650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.245290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] PATH_INFO: `/v3/projects/87237ba57bcd4f57b02837d3be0a174d/users/ae3eb129fa6c4af698662983ba921645/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.273817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87237ba57bcd4f57b02837d3be0a174d, user_id=ae3eb129fa6c4af698662983ba921645, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.280671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e316d-a638-4e74-9de9-b9fb79c48497 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.297621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:15.301573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.305275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:15.347356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 887/1749] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:15 2022] PUT /identity/v3/projects/87237ba57bcd4f57b02837d3be0a174d/users/ae3eb129fa6c4af698662983ba921645/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:15.355453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.355932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.356343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.356670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 863/1750] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:15.365214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.385437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0e60e-996d-4e25-a40e-867858892bfe None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.423642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] MFA Rules not processed for user `ae3eb129fa6c4af698662983ba921645`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:15.425340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.612035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.613047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.613399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.613695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.614699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:15.615340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.621371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.624692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 888/1751] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:15.625670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.664919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a70ea-e9a3-437b-9056-5ea6d43aeeb9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.666467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 864/1752] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:15.671278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.680425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.681233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.681638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.681956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.682869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.694243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.698357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052c7b-fcf6-4dac-90a0-525e2413309d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.716115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.716804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.717129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.717624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.718712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.725227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8431eb-9479-44f5-980d-21956bfce024 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.777641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 889/1753] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:15.793759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.855943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 865/1754] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/projects => generated 355 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:15.872244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d478c-3608-4687-ade3-0544a13256b1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.873134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d478c-3608-4687-ade3-0544a13256b1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.877999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d478c-3608-4687-ade3-0544a13256b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.027177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edc583-3606-40a0-b023-907a100092c4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.037518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8b3d478c-3608-4687-ade3-0544a13256b1 None None] MFA Rules not processed for user `f6c8fbe67885443b8e373c8af032f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.039085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8b3d478c-3608-4687-ade3-0544a13256b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.137562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:16.256647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 866/1755] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.267815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.268572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.268856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.269132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.269620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.269846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.273506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.273932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.278702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.351489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:16.370079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 890/1756] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:15 2022] POST /identity/v3/users => generated 293 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:16.373672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.394336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] MFA Rules not processed for user `5fe7bb321ebf4bcb900cc5d6b7ee5517`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.400297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.430631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b8cb-a5a7-44a5-9dbb-faf570c6e7fb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.449157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.450238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.450238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.450552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.451965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.455379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.583271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 891/1757] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/users => generated 278 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:16.587333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.592229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.669671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 867/1758] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.669671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.671411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.690877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0e12f-620d-43ae-b1f4-c649eda47499 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.697998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b141f4-c705-419b-a611-670255841615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.699202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b141f4-c705-419b-a611-670255841615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.699605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b141f4-c705-419b-a611-670255841615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.700281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b141f4-c705-419b-a611-670255841615 admin admin] PATH_INFO: `/v3/users/eafb96a2051e44b6a0cc88204a632998` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.701770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b141f4-c705-419b-a611-670255841615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eafb96a2051e44b6a0cc88204a632998)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.705152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b141f4-c705-419b-a611-670255841615 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.828181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eafb96a2051e44b6a0cc88204a632998'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.854139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eafb96a2051e44b6a0cc88204a632998'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.875696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eafb96a2051e44b6a0cc88204a632998'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.876669 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eafb96a2051e44b6a0cc88204a632998'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.877353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eafb96a2051e44b6a0cc88204a632998'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.917258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd761dc1-c9a9-4d16-88a7-25ad1d609d10 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.921365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 868/1759] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:16 2022] DELETE /identity/v3/users/eafb96a2051e44b6a0cc88204a632998 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:16.921365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.924355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.020973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:17.171962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.173450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.173887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.174314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.180523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.194325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b141f4-c705-419b-a611-670255841615 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.214346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.215474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.215986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.216487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.217548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.220063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.238430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 869/1760] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.238430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.240499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.268860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33591a-add8-46f6-9bfa-e742375b7ff4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.292961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.293932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.294290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.294572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.296626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.300050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b4963-57bc-4bbc-86cd-ef9e396ae28a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.339031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 870/1761] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.343742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.344043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.344661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.411383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] MFA Rules not processed for user `5fe7bb321ebf4bcb900cc5d6b7ee5517`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:17.412734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.437449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.458748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2947ade-d43e-4426-ade1-8a2ed1cff34c service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.511831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 892/1762] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:17.522629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.522937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.523203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.564791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:17.569165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.596032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 871/1763] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:17.598297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.610973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 893/1764] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:17.612013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.615113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ecdd0-de69-48b9-95c0-6d55f2b35025 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.621145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.622166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.622709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.623195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.624197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.626201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.655731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 872/1765] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.657094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.661270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.669219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e833b3-a14e-4948-9aa8-eace95ff2fab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.682978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c6bca-4b8f-412e-95df-485a37b92c53 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.697792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.699757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.701402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.703596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.710345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.711754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.712029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.712307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.713063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.713371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.714722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.717784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:17.732845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 894/1766] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.733982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.746861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5dfe-212c-4b98-a792-a573f9b005f3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.754260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.755372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.755764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.756148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] PATH_INFO: `/v3/projects/9a2ed6cd01c34840b84187baff5ad628/users/beb3cf2c30aa42a2b5a16a40590fc262/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.797560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2ed6cd01c34840b84187baff5ad628, user_id=beb3cf2c30aa42a2b5a16a40590fc262, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.802848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.850562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 895/1767] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:17 2022] PUT /identity/v3/projects/9a2ed6cd01c34840b84187baff5ad628/users/beb3cf2c30aa42a2b5a16a40590fc262/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:17.854299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.937114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.944212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.996491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 873/1768] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:18.002087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.012184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.072230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecddc4-5804-4067-8224-5147ffaf7ffa admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.104927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.106586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.106871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.107139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] PATH_INFO: `/v3/projects/434029b2ec304a6da766763e0fd627ef/users/6f6c1acda63a4d5891bcae14f15c3e74/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.173104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=434029b2ec304a6da766763e0fd627ef, user_id=6f6c1acda63a4d5891bcae14f15c3e74, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.178330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5c7eb-7612-477f-9ccc-1302b61662cf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.223967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 896/1769] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:17 2022] PUT /identity/v3/projects/434029b2ec304a6da766763e0fd627ef/users/6f6c1acda63a4d5891bcae14f15c3e74/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:18.225798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388579cf-2ca8-41da-a384-30f3059d08c3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.226190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388579cf-2ca8-41da-a384-30f3059d08c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.228462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388579cf-2ca8-41da-a384-30f3059d08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.287698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:18.309083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-388579cf-2ca8-41da-a384-30f3059d08c3 None None] MFA Rules not processed for user `beb3cf2c30aa42a2b5a16a40590fc262`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:18.311124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-388579cf-2ca8-41da-a384-30f3059d08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.394832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf089-2cff-4f9c-ae71-5280ee3ea2db service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.594232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 897/1770] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:18.594232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.594232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.594232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.656960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.661829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.664877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.666227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.754357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] MFA Rules not processed for user `6f6c1acda63a4d5891bcae14f15c3e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:18.762783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.920938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.921636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:18.927534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.969044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 874/1771] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 970 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:18.973693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.005267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02390a-7055-415e-8835-78463dcaf3ce service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.021019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.021986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.022426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.022832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.023826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.037274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.098213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 898/1772] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:19.099870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.115382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 875/1773] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:19.115382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.609421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2a0d1-9072-4a08-8ef7-537b37b1f808 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.646198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5908f2a-0893-4342-b0ef-3e3ea18be0f7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.665380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.666602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.666878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.670501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.675228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.681340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.894920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 876/1774] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/projects => generated 357 bytes in 781 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:19.897610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.938219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:20.023342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.023954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.024250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.024514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.038001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.177314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2de68d-78d0-4547-b7ca-3b632697ff6e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.224165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.225441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.225939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.231022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.235518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.246359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.348538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 877/1775] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/users => generated 299 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:20.352466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.360835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.435803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f1ac-4337-4b73-a735-ff521d97aea8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.468084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.478427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.484053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.485826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.486636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.486753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] PATH_INFO: `/v3/users/4de44609e89644c59516d9bdaf494f87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.506599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de44609e89644c59516d9bdaf494f87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.512710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.516310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 899/1776] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 1418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:20.518074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.544025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae43c20-e1cc-463f-b1e8-0d7808c20c55 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.561958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.567285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.567924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.568418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.573617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.591300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.650385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:20.678045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 900/1777] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:20 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:20.680602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.717564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de44609e89644c59516d9bdaf494f87'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.746196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ca49-095b-413b-bf25-aa931fe8745b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.761216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de44609e89644c59516d9bdaf494f87'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.797029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.803389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de44609e89644c59516d9bdaf494f87'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.803759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.804787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.807209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.809527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de44609e89644c59516d9bdaf494f87'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.810295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de44609e89644c59516d9bdaf494f87'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.811254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.823442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192315fb-8c68-42e5-a779-6b6756dc9b5a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.932016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 901/1778] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:20.934685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 878/1779] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:20 2022] DELETE /identity/v3/users/4de44609e89644c59516d9bdaf494f87 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.935400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.945703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.946040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.946325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.957616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.959213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 902/1780] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:25:20 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:20.960255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.969414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.191984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cb637-85a5-4fe6-9953-16ef5197471a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.207482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.210225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.211292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.213343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] PATH_INFO: `/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c/users/96f1026b50e84d9481840f189d45ad4a/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.218986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54343220-2b4e-4bfd-a91b-b49a47d595bd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.230347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.231881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.232733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.238042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.238042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.240742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c719f-2561-4ab2-a391-236fe096d730 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.263455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cd4717f5ec4e60adbd2c749769a54c, user_id=96f1026b50e84d9481840f189d45ad4a, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.267147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 879/1781] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:21.268950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.269949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8b5c-8b4a-405d-add9-9361b991286a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.270591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.271053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.303734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 903/1782] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:20 2022] PUT /identity/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c/users/96f1026b50e84d9481840f189d45ad4a/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:21.306920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.306920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.306920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.315995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:21.344364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.347651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.349633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.361485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.666020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 904/1783] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.667897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.689675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 880/1784] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.694153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.705060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4ea78-419d-4508-b01e-2cd6cf2bd041 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.716377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.718302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.718775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.720786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] PATH_INFO: `/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc/users/754a73821e3749c5af5e8052765a6052/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.734773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5b6b-bf02-456d-9358-81dd2431f632 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.751422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.752128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.752407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.752679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.753429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.755056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.808598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 881/1785] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:21.810056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.819452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9d17ceacc143c5b3d759ab4a2e16bc, user_id=754a73821e3749c5af5e8052765a6052, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.827029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c6296-35dd-456f-a6eb-4be5d8dc1488 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.858239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61845fe8-54c3-4154-bd9c-8ac50bac7468 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.876829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 905/1786] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:21 2022] PUT /identity/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc/users/754a73821e3749c5af5e8052765a6052/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:21.878851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a05b1-4f5b-466e-831e-f3e36254dd6f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.879466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a05b1-4f5b-466e-831e-f3e36254dd6f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.880146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a05b1-4f5b-466e-831e-f3e36254dd6f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.883596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 906/1787] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:21.884637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a05b1-4f5b-466e-831e-f3e36254dd6f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.884770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.886547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.886732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.887218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] PATH_INFO: `/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c/users/96f1026b50e84d9481840f189d45ad4a/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.942800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cd4717f5ec4e60adbd2c749769a54c, user_id=96f1026b50e84d9481840f189d45ad4a, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.968041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02465e5-988c-4d80-a253-d2bcf05d66a8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.974311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.030025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a05b1-4f5b-466e-831e-f3e36254dd6f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.045241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 882/1788] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:21 2022] PUT /identity/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c/users/96f1026b50e84d9481840f189d45ad4a/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:22.062572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.063117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.063668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.203721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] MFA Rules not processed for user `96f1026b50e84d9481840f189d45ad4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:22.207089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.267078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.270312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.270532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.270925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.271797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.291557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d82a8-d576-489a-8eea-7b91d000b38f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.353506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 907/1789] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:22.353506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.353506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.353506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.433257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:22.434662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.572345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 883/1790] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:22.573570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.576843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.742030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 908/1791] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:22.746760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.749890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.812196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697aee-4fbf-4437-ae98-7206ca70218c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.817404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.818305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.818598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.819023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] PATH_INFO: `/v3/projects/c26e9bb1be1a4d8ab7d875a49fe9f0d5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.821097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26e9bb1be1a4d8ab7d875a49fe9f0d5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.823260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.824220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63c58-4942-4dca-868e-aefda5cb496f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.842362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.845057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.845382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.846059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.881042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.892642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.927923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 884/1792] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:22.930785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.959361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc069b-71de-4fed-8131-9e470d64b9b6 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.985212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26e9bb1be1a4d8ab7d875a49fe9f0d5', 'request_id': 'req-fc1e31df-ade8-424d-ac85-97aac9b354b4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.990843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:23.027262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26e9bb1be1a4d8ab7d875a49fe9f0d5', 'request_id': 'req-fc1e31df-ade8-424d-ac85-97aac9b354b4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.097572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26e9bb1be1a4d8ab7d875a49fe9f0d5', 'request_id': 'req-fc1e31df-ade8-424d-ac85-97aac9b354b4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.116472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:23.157658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] The token cache is being invalidate because project c26e9bb1be1a4d8ab7d875a49fe9f0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:23.158107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.160474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.167017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 909/1793] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:22 2022] DELETE /identity/v3/projects/c26e9bb1be1a4d8ab7d875a49fe9f0d5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.168402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.172031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.289693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.303821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.309677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.310458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] PATH_INFO: `/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc/users/754a73821e3749c5af5e8052765a6052/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.320786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9d17ceacc143c5b3d759ab4a2e16bc, user_id=754a73821e3749c5af5e8052765a6052, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.329552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.381652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 885/1794] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:22 2022] PUT /identity/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc/users/754a73821e3749c5af5e8052765a6052/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.387070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.390698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.402277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e31df-ade8-424d-ac85-97aac9b354b4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.553183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.554017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.554374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.554787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.556978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.608273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f6e6-b80e-4228-9d03-a646d8d40dbc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.616112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.629956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.631809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.632992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.639958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.698200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.709526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.716671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.718622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4837527-0bac-4ffd-b840-7d8e135afe6b service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.729105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 886/1795] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:23.730013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.741057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.780837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 910/1796] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:23.784529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.790163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.790724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.904791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] MFA Rules not processed for user `754a73821e3749c5af5e8052765a6052`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:23.906059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.009603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b60cd-082e-4b56-a034-e08b5cdc5b0f service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.035591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.038758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.038758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.038758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] PATH_INFO: `/v3/users/f39c3bdea4ef46868836f835f41a5299` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.041968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39c3bdea4ef46868836f835f41a5299)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.050260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.126496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.190473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.266143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39c3bdea4ef46868836f835f41a5299'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.271273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 911/1797] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:24.272360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.321742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39c3bdea4ef46868836f835f41a5299'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.336445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39c3bdea4ef46868836f835f41a5299'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.337657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39c3bdea4ef46868836f835f41a5299'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.339814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39c3bdea4ef46868836f835f41a5299'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.341700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5537-c43f-45e3-870d-5e8d30f1feac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.388229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.388849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 887/1798] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:23 2022] DELETE /identity/v3/users/f39c3bdea4ef46868836f835f41a5299 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:24.389293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.390086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.391894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.396157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.396516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.406826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.449303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.461826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.502285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 912/1799] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:24.577116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5557a-fdb4-4c66-9df6-df68555bcc8a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.589241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.590238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.590545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.590826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.600694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.854782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.856448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.875756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 888/1800] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:25.180419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.182001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.188227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.202271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9888-fa15-4400-8d64-aa3329ec4c93 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.206935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.208048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.208158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1856aa-4fde-4ec3-a777-af61a790a7a4 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.208736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.209305 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.212646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.223255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.223925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.224217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.224558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.232502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.492043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.499011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.516350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.524601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b9bb-2476-410d-9e90-5574485ce1df service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.530047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 913/1801] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:25.570047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:25.600508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 889/1802] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:25.902641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.906086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:26.076681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d124-d4ef-4a44-b4ca-06e229622001 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:26.085758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:26.086924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.087248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.087627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] PATH_INFO: `/v3/projects/9a0def8e293e42c5b7f93ddf4d0760ef` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.089833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0def8e293e42c5b7f93ddf4d0760ef)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:26.091506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:26.165445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0def8e293e42c5b7f93ddf4d0760ef', 'request_id': 'req-2db20ac8-e579-4e1c-94e5-2d5eba848e49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:26.185433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0def8e293e42c5b7f93ddf4d0760ef', 'request_id': 'req-2db20ac8-e579-4e1c-94e5-2d5eba848e49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:26.205910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0def8e293e42c5b7f93ddf4d0760ef', 'request_id': 'req-2db20ac8-e579-4e1c-94e5-2d5eba848e49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:26.228986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:26.247528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] The token cache is being invalidate because project 9a0def8e293e42c5b7f93ddf4d0760ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:26.248180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:26.252772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2db20ac8-e579-4e1c-94e5-2d5eba848e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:26.263658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 914/1803] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:25 2022] DELETE /identity/v3/projects/9a0def8e293e42c5b7f93ddf4d0760ef => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:26.272605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.276561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.282816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.346572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:26.350876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:26.559950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 890/1804] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:26.562076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.562510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.563072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.608059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:26.614741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:26.647440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 915/1805] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:26.654205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:26.681164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505973-d094-40d4-b11e-1ca720d3c2cc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:26.689683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:26.690398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.690684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.690960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.691755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:26.692070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:26.693775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:26.708872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 891/1806] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:26.714630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:26.732022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8fbdd-773f-4549-8acd-e58a9de41b05 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:26.744601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:26.746344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.746965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.747751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.749106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:26.753346 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:26.802765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 916/1807] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:26 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:26.803476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:26.816787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb1c9-a1ae-4f93-83e3-7a5d7e280ee4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:26.921950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:26.922606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.922952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.923251 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.924045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:26.926233 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:26.973672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 892/1808] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:26 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:26.978127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:26.989400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1be5e8-d62f-4f82-ad2d-ecdb7b1980ee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.007353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.008372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.008670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.009008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.009781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.014759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.055094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 917/1809] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:27.063922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.075898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621b211-07a3-49d4-a2c8-20d669982cb7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.082020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.082963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.083279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.083695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.084918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.087338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951e66-de34-4215-9dd0-68a5f87eae49 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.098636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 893/1810] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:27.102535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.117699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0c3e-e777-47eb-b360-0cb4c017a6cb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.132468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.133694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.134077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.134328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] PATH_INFO: `/v3/projects/90237e9296ec4208b0b6e22a51d201e7/users/1440a2df78a94182b1d7ee6eb10c5148/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.159219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90237e9296ec4208b0b6e22a51d201e7, user_id=1440a2df78a94182b1d7ee6eb10c5148, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.163064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.201689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 918/1811] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:27 2022] PUT /identity/v3/projects/90237e9296ec4208b0b6e22a51d201e7/users/1440a2df78a94182b1d7ee6eb10c5148/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:27.213311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.213692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.213940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.285271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.287624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:27.291229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] MFA Rules not processed for user `1440a2df78a94182b1d7ee6eb10c5148`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:27.296750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:27.470319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:27.503830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2b14-332c-4094-84a0-c50e13507689 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.518890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 894/1812] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:27.522392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.523765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.524675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.524964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.525247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] PATH_INFO: `/v3/projects/f646f50eebae4baca5a96a738efdbca6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.536374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f646f50eebae4baca5a96a738efdbca6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.538374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.555759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6e86-94e5-48a5-b1d2-50646b22be8c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.574639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.578409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.580849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.581369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.585279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.591853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.638292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f646f50eebae4baca5a96a738efdbca6', 'request_id': 'req-95e2772c-3255-42ec-ac8d-18dec795b180'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:27.640410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 895/1813] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:27.650090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.658070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f646f50eebae4baca5a96a738efdbca6', 'request_id': 'req-95e2772c-3255-42ec-ac8d-18dec795b180'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:27.671526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f646f50eebae4baca5a96a738efdbca6', 'request_id': 'req-95e2772c-3255-42ec-ac8d-18dec795b180'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:27.710008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] The token cache is being invalidate because project f646f50eebae4baca5a96a738efdbca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:27.710301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:27.711422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-95e2772c-3255-42ec-ac8d-18dec795b180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:27.717478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 919/1814] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:27 2022] DELETE /identity/v3/projects/f646f50eebae4baca5a96a738efdbca6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:27.724224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb9a9-9062-48c6-a89c-3ffab10df3c7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.724575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb9a9-9062-48c6-a89c-3ffab10df3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.724815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb9a9-9062-48c6-a89c-3ffab10df3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.797075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1acfb9a9-9062-48c6-a89c-3ffab10df3c7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:27.797884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1acfb9a9-9062-48c6-a89c-3ffab10df3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:27.863463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:27.902586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606922e-3484-4ab7-9a34-172ec7b16ac8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:27.920532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:27.921558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:27.921845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:27.922124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:27.922867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:27.933034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:27.990459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 896/1815] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:27 2022] POST /identity/v3/users => generated 298 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:27.994630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.000866 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.009916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 920/1816] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:28.019413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.019716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.019973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.037934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ef74-65c0-4df6-bf14-00b1502bf1af admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.054738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:28.059209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.064807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.066124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.066408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.066881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.068307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.070025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.071205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 921/1817] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:28.075849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.098542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 897/1818] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:28.103625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.118553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce4b7-1000-44c9-ba1c-8473bfbbf129 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.125742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.126601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.127051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.127376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.127728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4c81-7df1-4bd7-a8bd-9a823e27bb37 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.128324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:28.128699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.131007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.137057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.138508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.139033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.139854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] PATH_INFO: `/v3/projects/f45ca46ec4424a769fe44f08abaec082/users/0ad377880d70471da7b5cb51ac4b64a5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.151644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 922/1819] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:28.156613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.163816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ca46ec4424a769fe44f08abaec082, user_id=0ad377880d70471da7b5cb51ac4b64a5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.167805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.178293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775197d0-5c99-40a7-ab26-346c4b4e6631 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.194361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.195241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.195840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.196852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.198877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.203488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 898/1820] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:28 2022] PUT /identity/v3/projects/f45ca46ec4424a769fe44f08abaec082/users/0ad377880d70471da7b5cb51ac4b64a5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:28.204031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.206935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.262431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 923/1821] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:28.263689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.301489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26ac39-adfe-4bd2-a625-978a91809cf0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.339290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:28.356611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a618c9-cc3c-4818-807a-ea8906b62b24 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.365895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.366864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.367129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.367465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.368189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.370261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.374283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.375265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.375724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.376297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.377206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.379107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.391163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 899/1822] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:28.396252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.410413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 924/1823] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:28.412733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.412980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80e11-18a3-429b-8804-53f2996a89f7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.420138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.421437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.422000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.422448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] PATH_INFO: `/v3/projects/f45ca46ec4424a769fe44f08abaec082/users/0ad377880d70471da7b5cb51ac4b64a5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.426399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ca46ec4424a769fe44f08abaec082, user_id=0ad377880d70471da7b5cb51ac4b64a5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.429525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663380b-d271-407d-8b0f-69eb9c467803 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.433228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e9a1-6323-42b7-8fec-db4dd2fcf209 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.442245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.442962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.443241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.443536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.444636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.445342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 900/1824] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:28 2022] PUT /identity/v3/projects/f45ca46ec4424a769fe44f08abaec082/users/0ad377880d70471da7b5cb51ac4b64a5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:28.446508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.457294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.458051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.458721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.488545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 925/1825] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:28.496367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.511069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a86b3-d99c-4ae3-be9e-893779147c5a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.520033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] MFA Rules not processed for user `0ad377880d70471da7b5cb51ac4b64a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:28.521701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.699267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 901/1826] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:28.711199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.711920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.713551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.713684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.713892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.714168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.716589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.721148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.726583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:28.780438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 926/1827] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:28.781861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.806308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adcfd1-a682-4bb1-bb6a-92965a893bc8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.819584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.822312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.824252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.824564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] PATH_INFO: `/v3/projects/1351b18952d045b59d381fb946a6f11a/users/464375488eaa4ad79b7d153ef2e8e39a/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.865605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1351b18952d045b59d381fb946a6f11a, user_id=464375488eaa4ad79b7d153ef2e8e39a, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.872521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c9a47-8efc-4527-8732-d73e67b8947b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.909423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 927/1828] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:28 2022] PUT /identity/v3/projects/1351b18952d045b59d381fb946a6f11a/users/464375488eaa4ad79b7d153ef2e8e39a/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:28.926852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.927143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.927445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.946470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6d31-c66a-4c77-b396-ad613f4ac9df None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:29.023374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] MFA Rules not processed for user `464375488eaa4ad79b7d153ef2e8e39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:29.026140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:29.143622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:29.144458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.144744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.145021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.172090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:29.262089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 928/1829] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:29.271243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:29.343501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:29.345819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:29.382787 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 902/1830] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:29.419970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:29.526910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47ce3-5fea-452b-af3f-c29a8cfea284 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:29.560219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:29.565234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.565876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.567555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.572156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:29.578707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:29.692905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 929/1831] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:29.694781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:29.709398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a26f-2642-4854-959f-32251c43d530 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:29.846841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:29.887413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f84c4-f583-4741-90d3-2066bb31b29b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:29.896917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:29.897832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.898106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.898374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] PATH_INFO: `/v3/users/1440a2df78a94182b1d7ee6eb10c5148` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.904306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:29.905024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.905304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.905584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.906289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:29.908639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2ace9-ce0d-4ac6-b0b5-647a464f5190 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:29.911942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1440a2df78a94182b1d7ee6eb10c5148)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:29.913905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:29.970723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 930/1832] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:29 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:29.980748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56d6-4795-45dd-b6e7-5b4f7790549f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.981192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56d6-4795-45dd-b6e7-5b4f7790549f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.982074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56d6-4795-45dd-b6e7-5b4f7790549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.019705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-954e56d6-4795-45dd-b6e7-5b4f7790549f None None] MFA Rules not processed for user `f6c8fbe67885443b8e373c8af032f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:30.023026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-954e56d6-4795-45dd-b6e7-5b4f7790549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.045032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1440a2df78a94182b1d7ee6eb10c5148'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:30.065482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1440a2df78a94182b1d7ee6eb10c5148'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:30.073212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:30.094262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1440a2df78a94182b1d7ee6eb10c5148'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:30.094950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1440a2df78a94182b1d7ee6eb10c5148'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:30.095697 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1440a2df78a94182b1d7ee6eb10c5148'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:30.174981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 903/1833] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:29 2022] DELETE /identity/v3/users/1440a2df78a94182b1d7ee6eb10c5148 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:30.177498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.180959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.215962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 931/1834] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:30.217530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.217822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.218103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.296875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:30.299580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.482657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 932/1835] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:30.482979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778565d1-6a0b-43e8-b340-8d05be7d35c0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.488670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.489377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.489661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.489936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.490883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.492601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.500727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.504775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.552904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 904/1836] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:30.554169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.585530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca785-3ef1-4472-b430-ded5a5b021e3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.600193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.600894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.601177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.601514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.602727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.606011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.636472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 905/1837] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:30.647712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.671712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288eb0-5bc7-4898-96b6-decee435ed7c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.683094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197a8c-b5f0-42d5-b80b-ee7bc322b557 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.685060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.686231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.686571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.686898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] PATH_INFO: `/v3/projects/a995a72fcb49404bbb7bf3358d06ce63/users/6c9284ddbf00422c8539d891e4598a8e/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.703254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.704160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.704468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.704922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.719156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a995a72fcb49404bbb7bf3358d06ce63, user_id=6c9284ddbf00422c8539d891e4598a8e, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.724239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.725922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb29a98-2188-48f3-a694-46a553378d7f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.745148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.757039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 933/1838] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:30.782367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 906/1839] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:30 2022] PUT /identity/v3/projects/a995a72fcb49404bbb7bf3358d06ce63/users/6c9284ddbf00422c8539d891e4598a8e/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:30.783435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.783723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.783998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.851762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] MFA Rules not processed for user `6c9284ddbf00422c8539d891e4598a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:30.853593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.889002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:30.972412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 934/1840] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:30.977423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.112506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21f99-ff82-4387-9345-223683fefb30 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.118381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.119236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.119691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.120830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.122058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.124460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.157302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 907/1841] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:31.162366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.184546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d849c-3255-4164-bd6a-f50ed54ca31d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.309895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.310602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.310977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.311167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.311890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.313985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.369666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 935/1842] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:31.374595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.389232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b154e9-10f7-4561-94b2-2a50dab83b68 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.395736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.396716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.397006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.397282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.398187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.399873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.420308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 908/1843] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:31.420445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.435939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf42a3-c589-4a3f-a191-69c712c5be30 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.448888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.449817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.450095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.450369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] PATH_INFO: `/v3/projects/e5f03395bb5841dc98219905dc9c21f8/users/2106971b7a954c37869099e5b74babc8/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.471891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f03395bb5841dc98219905dc9c21f8, user_id=2106971b7a954c37869099e5b74babc8, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.474812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.499521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 936/1844] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:31 2022] PUT /identity/v3/projects/e5f03395bb5841dc98219905dc9c21f8/users/2106971b7a954c37869099e5b74babc8/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:31.503158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.517115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbf379-7e7e-412b-9f4a-eb7c6f589355 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.532412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:31.636281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.639448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.640009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.640541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.641724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.644571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.671092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 909/1845] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:31.675145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.693403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521460-2533-4059-9359-0eb5d264fc0d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.715194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.717613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.730001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.734059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.735111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.736933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] PATH_INFO: `/v3/projects/e5f03395bb5841dc98219905dc9c21f8/users/2106971b7a954c37869099e5b74babc8/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.743731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f03395bb5841dc98219905dc9c21f8, user_id=2106971b7a954c37869099e5b74babc8, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.754586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220adfb-5159-40e7-9054-697352362f6b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.810542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 937/1846] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:31 2022] PUT /identity/v3/projects/e5f03395bb5841dc98219905dc9c21f8/users/2106971b7a954c37869099e5b74babc8/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:31.823649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.823649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.823925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.884725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] MFA Rules not processed for user `2106971b7a954c37869099e5b74babc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:31.885971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.938026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8d998-8830-4ceb-b8bb-fe281af90d3b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.060522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.094564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.095201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.095490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.095765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.097575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 938/1847] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:32.102957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.106164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.108695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.151276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40154d-caac-439b-8c69-1ac909da0377 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.192858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.195171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.198221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.199734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.231276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.236358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.275402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.277366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.278188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 939/1848] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:32.286387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.295935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.323898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 910/1849] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:32.343274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.360805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba02f1-16c2-465e-9635-e4ce753239d5 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.377834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.379046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.379046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.379046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.383897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.412798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.533632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c639448-1afd-47f5-bc62-ec15741f40d5 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.547287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.550758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.553016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.553305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.553585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] PATH_INFO: `/v3/projects/90237e9296ec4208b0b6e22a51d201e7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.554464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dff09-8137-4155-9a3a-5e6aa1c9ad16 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.557192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90237e9296ec4208b0b6e22a51d201e7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.563081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.591717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 911/1850] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:32.598142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d28d-f80b-44c2-857c-56a3b481af2b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.598503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d28d-f80b-44c2-857c-56a3b481af2b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.598864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d28d-f80b-44c2-857c-56a3b481af2b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.606531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 912/1851] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:25:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:32.608165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.608539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.608817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.682714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:32.686808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.715742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90237e9296ec4208b0b6e22a51d201e7', 'request_id': 'req-54811fab-49d1-4611-8bd6-dcbefc25ff65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.749974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90237e9296ec4208b0b6e22a51d201e7', 'request_id': 'req-54811fab-49d1-4611-8bd6-dcbefc25ff65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.777085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90237e9296ec4208b0b6e22a51d201e7', 'request_id': 'req-54811fab-49d1-4611-8bd6-dcbefc25ff65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.817449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] The token cache is being invalidate because project 90237e9296ec4208b0b6e22a51d201e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:32.820358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.822718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.828037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 940/1852] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:32 2022] DELETE /identity/v3/projects/90237e9296ec4208b0b6e22a51d201e7 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:32.829302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.833780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.956186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 913/1853] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:32.976205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.977817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:33.002413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0b107-e1d3-4d62-91a4-9b4a7164831f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.016063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.016988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.017635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.017923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.041797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.043708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.072883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 914/1854] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:33.081739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54811fab-49d1-4611-8bd6-dcbefc25ff65 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.103719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.104651 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.106163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.106468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] PATH_INFO: `/v3/users/0ad377880d70471da7b5cb51ac4b64a5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.109134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad377880d70471da7b5cb51ac4b64a5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.115245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.158734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:33.274188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad377880d70471da7b5cb51ac4b64a5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:33.289457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad377880d70471da7b5cb51ac4b64a5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:33.326109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad377880d70471da7b5cb51ac4b64a5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:33.326873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad377880d70471da7b5cb51ac4b64a5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:33.390706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8d90160b-340d-4425-bc2f-c3a712420de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad377880d70471da7b5cb51ac4b64a5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:33.400880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 941/1855] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:32 2022] DELETE /identity/v3/users/0ad377880d70471da7b5cb51ac4b64a5 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:34.479937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:34.500820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a07d9-3777-4948-b4e3-9caf74c51c79 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:34.633512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:34.635538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:34.635538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:34.635538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] PATH_INFO: `/v3/projects/f45ca46ec4424a769fe44f08abaec082` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:34.636260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45ca46ec4424a769fe44f08abaec082)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:34.638986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:34.700726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:34.715178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45ca46ec4424a769fe44f08abaec082', 'request_id': 'req-b8bc59c1-cce2-4c5d-b28a-f792932b270a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:34.724771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45ca46ec4424a769fe44f08abaec082', 'request_id': 'req-b8bc59c1-cce2-4c5d-b28a-f792932b270a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:34.739987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45ca46ec4424a769fe44f08abaec082', 'request_id': 'req-b8bc59c1-cce2-4c5d-b28a-f792932b270a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:34.763068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] The token cache is being invalidate because project f45ca46ec4424a769fe44f08abaec082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:34.763441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:34.766538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b8bc59c1-cce2-4c5d-b28a-f792932b270a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:34.779551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 915/1856] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:34 2022] DELETE /identity/v3/projects/f45ca46ec4424a769fe44f08abaec082 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:34.780422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:34.782428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:34.782825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:34.808547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:34.813282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:34.974147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 942/1857] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:34.974541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:34.974879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:34.975184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.011761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:35.013059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:35.029105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 916/1858] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:35.033825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.051124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87d49e-7330-4979-8483-9faecf2d0af8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.067526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.068374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.068666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.068948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.069702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:35.070013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.076103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.113062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 943/1859] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:35.117860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.135483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919efe-0faf-4175-8d8b-9b86d951529c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.144602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.145438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.145826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.146203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.148176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.151883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.219470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 917/1860] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:35 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:35.223858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.239199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f3809-b24b-4d99-a24c-2718d9b3bbe9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.345183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.346302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.346660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.347268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.348381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.360953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.421984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 944/1861] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:35 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:35.428160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.443751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5bcb-df6c-4c68-a7e6-94435bb365cc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.450844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.451809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.452959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.453259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.454332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.456909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.482122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 918/1862] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:35.483541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.502278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3ed5f-d91f-4354-b049-67598abee80d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.507902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.508794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.509176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.510286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.511140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.512933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f15e5-e396-4f79-b64e-bb40f4e25533 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.516070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:35.543482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 945/1863] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:35.547969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.565307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc7ca-ebd3-48e4-a93e-946d9b08ba5b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.587104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.588162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.588597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.588839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] PATH_INFO: `/v3/projects/482a8a5087274c2288c5a3cef0fc4e40/users/7c07dd77775f42baa5394fb4df4a4c51/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.611689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482a8a5087274c2288c5a3cef0fc4e40, user_id=7c07dd77775f42baa5394fb4df4a4c51, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.615081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:35.665074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 919/1864] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:35 2022] PUT /identity/v3/projects/482a8a5087274c2288c5a3cef0fc4e40/users/7c07dd77775f42baa5394fb4df4a4c51/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:35.669033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.669340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.669625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.705011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] MFA Rules not processed for user `7c07dd77775f42baa5394fb4df4a4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:35.706266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:35.841714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 946/1865] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:35.847252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:35.946558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c1e4-ee48-4076-9425-15feabb91812 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:35.954911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:35.955942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:35.956391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:35.957931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:35.960276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:35.963675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.011949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 920/1866] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:35 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:36.019546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.035070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.037563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.038665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ae92-1055-4501-9777-8fb6b1c9910f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.097502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:36.119733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.120685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.121163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.121529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.122262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.124835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.129711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e6e9-5f27-4fc6-a52d-b593d0250894 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.135828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.137071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.137407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.137644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] PATH_INFO: `/v3/users/ae3eb129fa6c4af698662983ba921645` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.138930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3eb129fa6c4af698662983ba921645)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.141080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.151341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 947/1867] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:36 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:36.153725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.167047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8db46-4b07-4051-aff6-4effe4658c2b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.172636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.173448 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.173727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.174019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.174789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.176687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.187926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 948/1868] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:36.192181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.198888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3eb129fa6c4af698662983ba921645'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.204530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd921835-326f-46ae-8c45-bcaa558135e4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.206753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3eb129fa6c4af698662983ba921645'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.209401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.210311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.210853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.211198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] PATH_INFO: `/v3/projects/81451311b047404585bfb3c683b474bf/users/33652b0eb840439a86c531d2b4af7414/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.227852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3eb129fa6c4af698662983ba921645'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.228771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3eb129fa6c4af698662983ba921645'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.229611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d154a92-7f7b-447a-8eee-f78f689b6daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3eb129fa6c4af698662983ba921645'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.232016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81451311b047404585bfb3c683b474bf, user_id=33652b0eb840439a86c531d2b4af7414, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.235140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.253766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 949/1869] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:36 2022] PUT /identity/v3/projects/81451311b047404585bfb3c683b474bf/users/33652b0eb840439a86c531d2b4af7414/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:36.257544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.262748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.272838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 921/1870] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:36 2022] DELETE /identity/v3/users/ae3eb129fa6c4af698662983ba921645 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:36.285041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.285886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.286234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.310222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:36.312380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.321479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:36.349585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a29a8-f99b-4117-8ca5-b183f6c01733 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.424997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.426125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.426557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.426905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.427885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.430171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.447764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 922/1871] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:36.453125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 950/1872] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:36.457371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.462753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.466602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.482360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004b8d7-e24a-4998-9321-c33262ebe910 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.492496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.493439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.493723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.494001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] PATH_INFO: `/v3/projects/81451311b047404585bfb3c683b474bf/users/33652b0eb840439a86c531d2b4af7414/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.497385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81451311b047404585bfb3c683b474bf, user_id=33652b0eb840439a86c531d2b4af7414, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.502418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896c69e-c167-4d8b-9538-776eecf52a66 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.541462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 923/1873] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:36 2022] PUT /identity/v3/projects/81451311b047404585bfb3c683b474bf/users/33652b0eb840439a86c531d2b4af7414/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:36.543053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.543713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.543967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.594122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] MFA Rules not processed for user `33652b0eb840439a86c531d2b4af7414`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:36.595682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.605397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767fc87-4b12-4aeb-a7e7-9c21b26f7e50 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.701768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:36.724759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.725584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.725987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.726328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.779199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 924/1874] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:36.818687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.824938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.840210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:36.866126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.870407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.901926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 951/1875] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:36.903103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.904828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.996594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0dc48-a0eb-43e9-8868-8d32dacf8d6a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.000586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.001771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.002217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.002685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] PATH_INFO: `/v3/users/464375488eaa4ad79b7d153ef2e8e39a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.006366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=464375488eaa4ad79b7d153ef2e8e39a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.008947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.022820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9551-94ea-4e23-aef8-6ca51e7e190e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.028111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.028949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.029501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.029877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.044711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.046447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3685-ef56-41a6-aeb0-63f69379baa3 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.066808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 952/1876] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:37.091469 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464375488eaa4ad79b7d153ef2e8e39a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.100758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464375488eaa4ad79b7d153ef2e8e39a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.117681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464375488eaa4ad79b7d153ef2e8e39a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.118530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464375488eaa4ad79b7d153ef2e8e39a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.119367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464375488eaa4ad79b7d153ef2e8e39a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.164064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 925/1877] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:36 2022] DELETE /identity/v3/users/464375488eaa4ad79b7d153ef2e8e39a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:37.169452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.170498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.171010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.197076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:37.198341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.237271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.240383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.321234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 953/1878] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:37.343397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.344951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.354889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078338-49c4-4dba-908e-481f6def7400 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.362964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.364067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.365247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.366343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.369247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.383997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:37.449053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743db6b-fb20-44be-8c76-c053978a5d33 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.461373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.462068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.462660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.462660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.485948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.486825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.490319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.491791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.513028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 926/1879] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:37.530202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.537527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.565784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 954/1880] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:37.573116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d451ac-a27d-4f27-bba1-591830ff4966 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.584854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.588754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.589189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.589495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] PATH_INFO: `/v3/projects/87237ba57bcd4f57b02837d3be0a174d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.601921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87237ba57bcd4f57b02837d3be0a174d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.605261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.689071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87237ba57bcd4f57b02837d3be0a174d', 'request_id': 'req-5a696b70-04d9-4e48-9579-d3086e3a69e8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.701632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87237ba57bcd4f57b02837d3be0a174d', 'request_id': 'req-5a696b70-04d9-4e48-9579-d3086e3a69e8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.719921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87237ba57bcd4f57b02837d3be0a174d', 'request_id': 'req-5a696b70-04d9-4e48-9579-d3086e3a69e8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.758796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] The token cache is being invalidate because project 87237ba57bcd4f57b02837d3be0a174d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:37.759071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.761746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.768433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 927/1881] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:37 2022] DELETE /identity/v3/projects/87237ba57bcd4f57b02837d3be0a174d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:37.773553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.790612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b713-b6a7-4cf5-baaa-fb0e25615407 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.907752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:37.948767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.951832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.956418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.956874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] PATH_INFO: `/v3/users/beb3cf2c30aa42a2b5a16a40590fc262` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.960635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb3cf2c30aa42a2b5a16a40590fc262)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.964806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.114764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb3cf2c30aa42a2b5a16a40590fc262'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.133379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb3cf2c30aa42a2b5a16a40590fc262'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.151913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb3cf2c30aa42a2b5a16a40590fc262'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.157199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb3cf2c30aa42a2b5a16a40590fc262'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.173043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb3cf2c30aa42a2b5a16a40590fc262'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.188916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 955/1882] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:37 2022] DELETE /identity/v3/users/beb3cf2c30aa42a2b5a16a40590fc262 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:38.407012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.409164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.453362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696b70-04d9-4e48-9579-d3086e3a69e8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.582287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.584222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.584738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.585307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] PATH_INFO: `/v3/projects/1351b18952d045b59d381fb946a6f11a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.587097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1351b18952d045b59d381fb946a6f11a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.590438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.662778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:38.684493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1351b18952d045b59d381fb946a6f11a', 'request_id': 'req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.693079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1351b18952d045b59d381fb946a6f11a', 'request_id': 'req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.707657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1351b18952d045b59d381fb946a6f11a', 'request_id': 'req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.730435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] The token cache is being invalidate because project 1351b18952d045b59d381fb946a6f11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:38.731183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.732636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.735665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 928/1883] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:38 2022] DELETE /identity/v3/projects/1351b18952d045b59d381fb946a6f11a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:38.740198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.759623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.787477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379fc36-7a01-4348-a814-af36c3bac2f1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.958658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.960991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.961467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.961955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] PATH_INFO: `/v3/users/6c9284ddbf00422c8539d891e4598a8e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.967920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9284ddbf00422c8539d891e4598a8e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.970765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.121139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9284ddbf00422c8539d891e4598a8e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.146866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9284ddbf00422c8539d891e4598a8e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.150185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.169848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9284ddbf00422c8539d891e4598a8e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.170702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9284ddbf00422c8539d891e4598a8e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.183195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9284ddbf00422c8539d891e4598a8e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.197012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 956/1884] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:38 2022] DELETE /identity/v3/users/6c9284ddbf00422c8539d891e4598a8e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:39.565886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.567820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.586069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac61e-d751-4a46-bd55-f6cf4439f1a1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.702676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.705819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.706140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.706424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] PATH_INFO: `/v3/projects/9a2ed6cd01c34840b84187baff5ad628` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.708064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2ed6cd01c34840b84187baff5ad628)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.710303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.776847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2ed6cd01c34840b84187baff5ad628', 'request_id': 'req-336c0db9-21d0-4f1b-b72b-2247f902d13c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.785829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2ed6cd01c34840b84187baff5ad628', 'request_id': 'req-336c0db9-21d0-4f1b-b72b-2247f902d13c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.795940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2ed6cd01c34840b84187baff5ad628', 'request_id': 'req-336c0db9-21d0-4f1b-b72b-2247f902d13c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.818490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] The token cache is being invalidate because project 9a2ed6cd01c34840b84187baff5ad628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:39.818941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.820097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.822940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 929/1885] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:39 2022] DELETE /identity/v3/projects/9a2ed6cd01c34840b84187baff5ad628 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:39.826985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.829526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.844252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63992-5cf4-4dfb-a9b7-ab7984aa6768 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.862958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.865374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.917979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.918912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.919182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.919503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] PATH_INFO: `/v3/users/96f1026b50e84d9481840f189d45ad4a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.920789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f1026b50e84d9481840f189d45ad4a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.922871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.934246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.948460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0db9-21d0-4f1b-b72b-2247f902d13c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.956193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.957117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.957432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.957711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] PATH_INFO: `/v3/projects/a995a72fcb49404bbb7bf3358d06ce63` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.958993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a995a72fcb49404bbb7bf3358d06ce63)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.960951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.978852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f1026b50e84d9481840f189d45ad4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.989609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f1026b50e84d9481840f189d45ad4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.005612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f1026b50e84d9481840f189d45ad4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.006267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f1026b50e84d9481840f189d45ad4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.013872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f1026b50e84d9481840f189d45ad4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.016487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a995a72fcb49404bbb7bf3358d06ce63', 'request_id': 'req-0dbb5344-2b7b-4ad6-ac61-c413f6567608'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.020413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 957/1886] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:39 2022] DELETE /identity/v3/users/96f1026b50e84d9481840f189d45ad4a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:40.023538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a995a72fcb49404bbb7bf3358d06ce63', 'request_id': 'req-0dbb5344-2b7b-4ad6-ac61-c413f6567608'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.032380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a995a72fcb49404bbb7bf3358d06ce63', 'request_id': 'req-0dbb5344-2b7b-4ad6-ac61-c413f6567608'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.045098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] The token cache is being invalidate because project a995a72fcb49404bbb7bf3358d06ce63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:40.045426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.046110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.047821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 930/1887] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:39 2022] DELETE /identity/v3/projects/a995a72fcb49404bbb7bf3358d06ce63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:40.051957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.053503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.117014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:40.136582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37137e8-34c8-4daf-b411-83bbbb855d87 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.143479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.146652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.147295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.147712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] PATH_INFO: `/v3/users/2106971b7a954c37869099e5b74babc8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.149546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2106971b7a954c37869099e5b74babc8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.152067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.228610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2106971b7a954c37869099e5b74babc8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.243387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2106971b7a954c37869099e5b74babc8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.260607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2106971b7a954c37869099e5b74babc8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.261656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2106971b7a954c37869099e5b74babc8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.269824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2106971b7a954c37869099e5b74babc8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.277506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 958/1888] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:40 2022] DELETE /identity/v3/users/2106971b7a954c37869099e5b74babc8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:40.365907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.367895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.458829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5344-2b7b-4ad6-ac61-c413f6567608 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.546589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.548152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.548152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.548406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] PATH_INFO: `/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.550187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cd4717f5ec4e60adbd2c749769a54c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.552412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.566244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.568497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.593677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4c21-aa20-4b88-b7d8-20bb50c222b4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.602992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.604169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.605070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.605178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] PATH_INFO: `/v3/users/7c07dd77775f42baa5394fb4df4a4c51` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.607627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c07dd77775f42baa5394fb4df4a4c51)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.611117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.619585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:40.633896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cd4717f5ec4e60adbd2c749769a54c', 'request_id': 'req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.643606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cd4717f5ec4e60adbd2c749769a54c', 'request_id': 'req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.656799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cd4717f5ec4e60adbd2c749769a54c', 'request_id': 'req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.677157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] The token cache is being invalidate because project b5cd4717f5ec4e60adbd2c749769a54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:40.677546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.678330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cad2b89c-2e42-4b28-b4a8-ea8c9dd3c216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.680593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 931/1889] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:40 2022] DELETE /identity/v3/projects/b5cd4717f5ec4e60adbd2c749769a54c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:40.690560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634a6c2-a768-4b32-9d98-cd368d7027aa None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.690951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634a6c2-a768-4b32-9d98-cd368d7027aa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.691296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634a6c2-a768-4b32-9d98-cd368d7027aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.724146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2634a6c2-a768-4b32-9d98-cd368d7027aa None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:40.726101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2634a6c2-a768-4b32-9d98-cd368d7027aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.751634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c07dd77775f42baa5394fb4df4a4c51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.766334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c07dd77775f42baa5394fb4df4a4c51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.791721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c07dd77775f42baa5394fb4df4a4c51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.792454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c07dd77775f42baa5394fb4df4a4c51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.800159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c07dd77775f42baa5394fb4df4a4c51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.806285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 959/1890] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:40 2022] DELETE /identity/v3/users/7c07dd77775f42baa5394fb4df4a4c51 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:40.807084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.809075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.818663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 932/1891] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:40.820157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e54a0-da38-4f3d-896d-d53de206264e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.820449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e54a0-da38-4f3d-896d-d53de206264e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.820725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e54a0-da38-4f3d-896d-d53de206264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.839830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bf2e54a0-da38-4f3d-896d-d53de206264e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:40.841163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf2e54a0-da38-4f3d-896d-d53de206264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.882184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:40.907120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332c84-98aa-465e-963a-a00e8a96ec56 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.925224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.926268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.926628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.926974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] PATH_INFO: `/v3/projects/e5f03395bb5841dc98219905dc9c21f8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.928495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f03395bb5841dc98219905dc9c21f8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.930517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.942092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 933/1892] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:40.943477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e897b-2aff-48c0-9cc7-eb0ba5bb6869 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.943771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e897b-2aff-48c0-9cc7-eb0ba5bb6869 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.944043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e897b-2aff-48c0-9cc7-eb0ba5bb6869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.980147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4a3e897b-2aff-48c0-9cc7-eb0ba5bb6869 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:40.981346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4a3e897b-2aff-48c0-9cc7-eb0ba5bb6869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.995196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f03395bb5841dc98219905dc9c21f8', 'request_id': 'req-6e29b994-9d16-4806-b828-863c795669bb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.004664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f03395bb5841dc98219905dc9c21f8', 'request_id': 'req-6e29b994-9d16-4806-b828-863c795669bb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.013320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f03395bb5841dc98219905dc9c21f8', 'request_id': 'req-6e29b994-9d16-4806-b828-863c795669bb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.027020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] The token cache is being invalidate because project e5f03395bb5841dc98219905dc9c21f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:41.027408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.028096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.030008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 960/1893] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:40 2022] DELETE /identity/v3/projects/e5f03395bb5841dc98219905dc9c21f8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:41.035585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.036355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.065751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 934/1894] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:41.068122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.068569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.069069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.076071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.092341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.094703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.109175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 935/1895] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:41.110508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.122206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad60719-d067-4e34-ab69-a8ff216b860d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.124663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b994-9d16-4806-b828-863c795669bb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.127114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.127856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.128140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.128424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.129345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:41.129743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.129860 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.130751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.131098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.131353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.131519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76f1d-cb99-4c43-a2d4-8e15e7d27f53 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.133423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.145991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.150368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 936/1896] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:41.150570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.150684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.150684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.150684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.160221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 961/1897] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:41.161060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.169447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.170825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.171428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7f9c-edd1-4ad4-a55a-daf28d00d689 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.176598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.177450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.177805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.178153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.178929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.182955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 937/1898] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:41.183125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.184227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.195316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac3bd0-adad-4503-ae42-79b8308605e5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.200540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.201335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.201657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.202002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.202851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:41.203288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.205148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.214472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 962/1899] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.216370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.224550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 938/1900] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:41.226154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.237420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee671-cbc0-4d62-9400-560fcd95d571 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.293221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.304123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1322-9492-404f-995a-e6c41b361601 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.313722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.314584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.315159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.315392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.315747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.316506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.316859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.317017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.317745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.318442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.320392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.320801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.351926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 963/1901] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:41.359212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.385474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 939/1902] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.385669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f496f-14a6-4214-80d1-b3012708e93a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.388109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.504832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.505544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.506014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.506297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.507950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.509594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.532586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 964/1903] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:41.538453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.542340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf83ab6-d9bb-4940-8463-ef9964f74e86 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.551630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.552330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.552619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.552897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.553606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.556117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc759-3620-449c-a52f-150f60d7c866 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.556509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.566106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.568431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.569133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.569706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.572399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.575373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.588719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 940/1904] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.592329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 965/1905] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:41.592502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.593606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.604091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e6a8-66ad-49cf-9cf0-b07bc1d50b16 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.605562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878842-2974-4893-a3e6-6349694fb459 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.610478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.611240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.612030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.612221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.612587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.613343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.613648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.613757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.614057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] PATH_INFO: `/v3/projects/8cd392d0f6484ae78ca657d744d99963/users/2540a2198e9c400fb9f8788626ef287b/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.618380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.635943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd392d0f6484ae78ca657d744d99963, user_id=2540a2198e9c400fb9f8788626ef287b, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.639130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b42dc-6821-4535-afe2-a870d91da38c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.651436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 941/1906] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:41.655812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.668903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 966/1907] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:41 2022] PUT /identity/v3/projects/8cd392d0f6484ae78ca657d744d99963/users/2540a2198e9c400fb9f8788626ef287b/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:41.675107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990e04-ddfb-401e-9c62-b66031b9822d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.682192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.682590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.682964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.716163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] MFA Rules not processed for user `2540a2198e9c400fb9f8788626ef287b`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.717512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.749303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.822402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.823106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.823537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.823748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.824428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.826107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.843823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 942/1908] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:41.845063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.847789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.855445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 967/1909] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:41.855445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.862146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef75329-b1a0-4235-ad23-ed5c97bc2656 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.867402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.868286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.868567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.868832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] PATH_INFO: `/v3/projects/482a8a5087274c2288c5a3cef0fc4e40` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.870188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c2d27-c790-40eb-994f-e157b9d8ed38 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.870618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482a8a5087274c2288c5a3cef0fc4e40)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.872601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.876105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.876485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.876732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.876970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] PATH_INFO: `/v3/projects/b98f5ba95fa34e318bec5f9c27c0d71f/users/a0c948b89a7e4a7dbd1ce66030c16da7/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.894195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98f5ba95fa34e318bec5f9c27c0d71f, user_id=a0c948b89a7e4a7dbd1ce66030c16da7, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.897268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.915910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 968/1910] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:41 2022] PUT /identity/v3/projects/b98f5ba95fa34e318bec5f9c27c0d71f/users/a0c948b89a7e4a7dbd1ce66030c16da7/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:41.917227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.952516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.954059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482a8a5087274c2288c5a3cef0fc4e40', 'request_id': 'req-cc207b7e-2327-44b7-bf9f-bc10de90a806'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.989420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482a8a5087274c2288c5a3cef0fc4e40', 'request_id': 'req-cc207b7e-2327-44b7-bf9f-bc10de90a806'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.009803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482a8a5087274c2288c5a3cef0fc4e40', 'request_id': 'req-cc207b7e-2327-44b7-bf9f-bc10de90a806'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.044502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf46a-3113-4af8-a20b-0eaa6ec4bd5e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.045387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] The token cache is being invalidate because project 482a8a5087274c2288c5a3cef0fc4e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:42.045742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.046458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc207b7e-2327-44b7-bf9f-bc10de90a806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.048385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 943/1911] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:41 2022] DELETE /identity/v3/projects/482a8a5087274c2288c5a3cef0fc4e40 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:42.049818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.050101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.050580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.109928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] MFA Rules not processed for user `a0c948b89a7e4a7dbd1ce66030c16da7`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:42.112976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.121829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.123986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.124574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.125019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.126882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.134736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.193740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 969/1912] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/projects => generated 401 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:42.193740 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.205746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.265756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 944/1913] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:42.267461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.269136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.301980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bb978-7f0f-426d-a3df-dfe626829690 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.329326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ef3f0-4ed9-4601-9966-1276223f40c7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.338885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.339925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.340208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.340578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] PATH_INFO: `/v3/users/33652b0eb840439a86c531d2b4af7414` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.341947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33652b0eb840439a86c531d2b4af7414)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.343605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:42.344008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.406029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.406705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.407179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.407569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.408689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.423112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.430339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:42.432989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33652b0eb840439a86c531d2b4af7414'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.445121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33652b0eb840439a86c531d2b4af7414'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.470858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33652b0eb840439a86c531d2b4af7414'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.471807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33652b0eb840439a86c531d2b4af7414'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.481824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 945/1914] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:42 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:42.486746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33652b0eb840439a86c531d2b4af7414'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.487745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.490504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.499074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 970/1915] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:42 2022] DELETE /identity/v3/users/33652b0eb840439a86c531d2b4af7414 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:42.500044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.501724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.531909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8072c4-55b6-4afd-99e7-acbeecddc92d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.617173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fd5dd-d430-4e37-a807-6b9e844bfee1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.632431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.633334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.633782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.634280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.635238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.637266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.657545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 971/1916] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:42.662838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.684327 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac978-f2a8-4361-9538-7cc32aff97d8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.700941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.701506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.702424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.702424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] PATH_INFO: `/v3/projects/7c7b73f011cd4464961c864bef79a4f1/users/96d93ad9ff294b6a9d7937f1e8423423/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.729258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7b73f011cd4464961c864bef79a4f1, user_id=96d93ad9ff294b6a9d7937f1e8423423, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.730432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.731241 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.731647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.732016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.732827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.734157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.735256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.767607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 972/1917] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:42 2022] PUT /identity/v3/projects/7c7b73f011cd4464961c864bef79a4f1/users/96d93ad9ff294b6a9d7937f1e8423423/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:42.770063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.791263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 946/1918] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:42 2022] POST /identity/v3/projects => generated 367 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:42.795557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.921862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4506-1005-489d-9ecc-65a1eafc0a78 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.927759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.928644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.929056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.929610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.930679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.934770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.968887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 947/1919] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:42 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:42.970364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.990738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba763-a90f-42fd-af77-7332228f69f1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.996874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.997865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.998329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.998749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.000121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.002299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.022657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 948/1920] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:43.024177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95464b-faa0-41e9-8d4a-841dc4f118a8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.024754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.038140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.039003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.039751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.040159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec1f4-e7dd-42c7-9eff-f543cbeaad76 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.040277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.042032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.045524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.053691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.054897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.055355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.055803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] PATH_INFO: `/v3/projects/4b870d98b28546a8acf6f936ba57032b/users/9ad39ea8ce414ae894e32b47a09a84c3/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.072233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 973/1921] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:43.076233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.086761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b870d98b28546a8acf6f936ba57032b, user_id=9ad39ea8ce414ae894e32b47a09a84c3, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.090182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.095691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c711c-12a8-43fa-a0aa-51fcf573466e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.102375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.103370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.103648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.103929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] PATH_INFO: `/v3/projects/7c7b73f011cd4464961c864bef79a4f1/users/96d93ad9ff294b6a9d7937f1e8423423/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.106596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7b73f011cd4464961c864bef79a4f1, user_id=96d93ad9ff294b6a9d7937f1e8423423, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.109532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463df63-fac6-4554-9ae7-61ed0d99ea3b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.112956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 949/1922] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:43 2022] PUT /identity/v3/projects/4b870d98b28546a8acf6f936ba57032b/users/9ad39ea8ce414ae894e32b47a09a84c3/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.117605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.131395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 974/1923] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:43 2022] PUT /identity/v3/projects/7c7b73f011cd4464961c864bef79a4f1/users/96d93ad9ff294b6a9d7937f1e8423423/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.133668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.137258 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.138395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.139934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.179759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] MFA Rules not processed for user `96d93ad9ff294b6a9d7937f1e8423423`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:43.181132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.188580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.290604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a539e-3cc0-4d0a-8ecf-7e2d70e708a2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.328566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 975/1924] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:43.340207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.341824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.478151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5c22-1fb3-4a37-b9b0-f96a6574a993 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.483721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.485239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.486318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.486909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.501628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.504699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.510688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.511544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.511827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.512099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.512869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.514752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.525482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 976/1925] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:43.526745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.528491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.566901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 950/1926] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:43.573615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.573790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816899b2-1650-4fe3-9d63-b57720c55df3 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.582208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.583350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.583689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.584007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] PATH_INFO: `/v3/projects/81451311b047404585bfb3c683b474bf` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.585452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81451311b047404585bfb3c683b474bf)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.587623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.598702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25a2ff-fbbe-49aa-b84a-6e17f2c6d8c7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.611850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.612956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.613398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.613885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] PATH_INFO: `/v3/projects/4b870d98b28546a8acf6f936ba57032b/users/9ad39ea8ce414ae894e32b47a09a84c3/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.617791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b870d98b28546a8acf6f936ba57032b, user_id=9ad39ea8ce414ae894e32b47a09a84c3, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.621687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729368-6566-4b0d-9a99-29307af7eed9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.642535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 951/1927] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:43 2022] PUT /identity/v3/projects/4b870d98b28546a8acf6f936ba57032b/users/9ad39ea8ce414ae894e32b47a09a84c3/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.656168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a98f-1963-4cc6-beda-a73d950e5856 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.657382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a98f-1963-4cc6-beda-a73d950e5856 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.657382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a98f-1963-4cc6-beda-a73d950e5856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.701908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7be4a98f-1963-4cc6-beda-a73d950e5856 None None] MFA Rules not processed for user `9ad39ea8ce414ae894e32b47a09a84c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:43.702112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81451311b047404585bfb3c683b474bf', 'request_id': 'req-c8098c30-2b5e-4196-8783-a2ac0788e1a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.703439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7be4a98f-1963-4cc6-beda-a73d950e5856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.714700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81451311b047404585bfb3c683b474bf', 'request_id': 'req-c8098c30-2b5e-4196-8783-a2ac0788e1a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.725473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81451311b047404585bfb3c683b474bf', 'request_id': 'req-c8098c30-2b5e-4196-8783-a2ac0788e1a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.738638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] The token cache is being invalidate because project 81451311b047404585bfb3c683b474bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:43.739100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.739923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.742303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 977/1928] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:43 2022] DELETE /identity/v3/projects/81451311b047404585bfb3c683b474bf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.743145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.744340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.836459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.890208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 952/1929] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:43.892005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.892300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.892579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.903264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098c30-2b5e-4196-8783-a2ac0788e1a4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.907282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.910741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.910741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.910741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.912205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.927264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:43.928820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.943723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.987960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.989831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfa4a-7ede-4380-ba97-952244b9e89d service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.020348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 953/1930] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:44.028926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.030454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.033588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 978/1931] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:44.037794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.038090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.038370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.073793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb70a3-a0de-4533-a1fd-0dae30a425f8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.081401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:44.087212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.087901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.089998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.092525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.093861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.106135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 979/1932] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:44.111272 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.117794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.122878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.133220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db557-2c55-4bc3-806e-4bdf65df76ab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.146701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.148677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.148910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.153131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.154123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:44.154435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.156445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.158435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 954/1933] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:44.187564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 980/1934] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:44.191271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.205024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab087b6-e23f-4fc6-a157-9bca087fca7b service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.212560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.213404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.214011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.214610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.215619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.220480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.279717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 955/1935] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:44.280964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.283522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.297624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c134f-dfb6-4227-9f02-620f3dfe2157 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.397900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.397900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.397900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.398385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.416893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.486985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a524-78a3-40a1-b1d3-245a9df2f7c8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.509382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.510122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.510407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.510689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.514012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.518930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.583646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 956/1936] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:44.587442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.606923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0a37-b459-4eac-8697-bf79e59e968a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.613748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.614452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.614737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.615011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.615926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.617812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.626900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.628606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.630252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 957/1937] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.636414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.657038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d83e61-9171-44b5-80a1-fc10d6180fdd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.666385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.667146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.667466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.667743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.668498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.669745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 981/1938] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:44.670150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56551d-5fd2-4bc7-a06f-c9b39f718b8e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.682645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 958/1939] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.687498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.700561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f265cc-8334-4cb1-b22d-dbb9f8b8ee9b service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.714260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.715669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.716147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.716573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] PATH_INFO: `/v3/projects/75cffa46ecbd4892863888f7d6a73b54/users/608f90331af547be87731a63475f8023/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.755637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cffa46ecbd4892863888f7d6a73b54, user_id=608f90331af547be87731a63475f8023, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.769065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.790776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:44.817769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 982/1940] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:44 2022] PUT /identity/v3/projects/75cffa46ecbd4892863888f7d6a73b54/users/608f90331af547be87731a63475f8023/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:44.819188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.819708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.820123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.880920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] MFA Rules not processed for user `608f90331af547be87731a63475f8023`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:44.882497 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.959702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.010702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 959/1941] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:45.015117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.154131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4212-ff5a-4b50-8cbe-70c55cff4446 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.161805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.162947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.163281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.163630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.164343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.167527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.220190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 983/1942] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:45.224474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.241591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2561-0de2-48e9-a37e-5afed9fd08f2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.360359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.363022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.363553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.364134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.371555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.373699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.395644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.397757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.412934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 960/1943] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:45.417413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.422115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8819b7-be92-450f-a825-0cc2dabddd54 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.427597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.428533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.428816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.429094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] PATH_INFO: `/v3/users/6f6c1acda63a4d5891bcae14f15c3e74` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.430411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6c1acda63a4d5891bcae14f15c3e74)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.432464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.444124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58acef5-6212-4b24-8b42-10dd7fc18f2e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.450547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.451961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.452526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.453030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.454704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.463590 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.471708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 961/1944] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:45.475998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.489767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54370-7ed5-4eb1-8747-06542ec5b39f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.496564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.498099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.498481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.498801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] PATH_INFO: `/v3/projects/fe25e52b60de4bca800178b6f04478e9/users/dc0aea66609a4e3d802d0f302e471788/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.519147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe25e52b60de4bca800178b6f04478e9, user_id=dc0aea66609a4e3d802d0f302e471788, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.521681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6c1acda63a4d5891bcae14f15c3e74'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.523250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.535048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6c1acda63a4d5891bcae14f15c3e74'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.544741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 962/1945] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:45 2022] PUT /identity/v3/projects/fe25e52b60de4bca800178b6f04478e9/users/dc0aea66609a4e3d802d0f302e471788/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:45.550554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.558080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6c1acda63a4d5891bcae14f15c3e74'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.558835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6c1acda63a4d5891bcae14f15c3e74'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.580722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fed32e8a-5516-4548-8611-45378f7dd9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6c1acda63a4d5891bcae14f15c3e74'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.589670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 984/1946] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:45 2022] DELETE /identity/v3/users/6f6c1acda63a4d5891bcae14f15c3e74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:45.595030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.595524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.595878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.616402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:45.618146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.655985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac7a4-46a0-4d93-ac87-d346969bf002 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.688267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.713224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 985/1947] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:45.726126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.728188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.728500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.752177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.754813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.755163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.755914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.756664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.759599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.780155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 963/1948] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:45.781882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.785415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.803890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce546a-9ce1-402b-aaf0-02417f138da5 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.808839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.810086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.810086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.810267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] PATH_INFO: `/v3/projects/fe25e52b60de4bca800178b6f04478e9/users/dc0aea66609a4e3d802d0f302e471788/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.811791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53004528-3fc5-4136-b35c-a6470e6180fb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.812852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe25e52b60de4bca800178b6f04478e9, user_id=dc0aea66609a4e3d802d0f302e471788, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.815813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4099-a724-4c5c-b0c7-0f82b1d1e680 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.816519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.817426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.817805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.818257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.829027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 964/1949] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:45 2022] PUT /identity/v3/projects/fe25e52b60de4bca800178b6f04478e9/users/dc0aea66609a4e3d802d0f302e471788/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:45.831872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.834556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.840665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.841045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.842627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.850247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 986/1950] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:45.879852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] MFA Rules not processed for user `dc0aea66609a4e3d802d0f302e471788`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:45.881244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.034952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 965/1951] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:46.055381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.056771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.165545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2399-b0b7-4158-83b2-0df0ca6e69ca service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.277376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.277992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.278280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.278625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.302707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.304246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.318239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 987/1952] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:46.431017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.432514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.611900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d19f6-927b-45a5-9f44-7058bc927860 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.632728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.635876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.636735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.637812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] PATH_INFO: `/v3/projects/434029b2ec304a6da766763e0fd627ef` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.640157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434029b2ec304a6da766763e0fd627ef)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.646191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.733248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434029b2ec304a6da766763e0fd627ef', 'request_id': 'req-8f7821ae-c437-47aa-b7eb-fc59367f0e02'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.746317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434029b2ec304a6da766763e0fd627ef', 'request_id': 'req-8f7821ae-c437-47aa-b7eb-fc59367f0e02'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.751874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.773298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434029b2ec304a6da766763e0fd627ef', 'request_id': 'req-8f7821ae-c437-47aa-b7eb-fc59367f0e02'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.791502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] The token cache is being invalidate because project 434029b2ec304a6da766763e0fd627ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:46.791963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.793224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.796768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 966/1953] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/projects/434029b2ec304a6da766763e0fd627ef => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.800869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.817720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46cad1-1962-4605-921b-1c6146501697 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.928683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.943110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.944670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.945368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.945857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] PATH_INFO: `/v3/users/754a73821e3749c5af5e8052765a6052` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.948230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754a73821e3749c5af5e8052765a6052)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.951846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.014447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:47.016548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.033050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7821ae-c437-47aa-b7eb-fc59367f0e02 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:47.040216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:47.041324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.041504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.041676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] PATH_INFO: `/v3/users/608f90331af547be87731a63475f8023` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.043251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754a73821e3749c5af5e8052765a6052'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.043523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=608f90331af547be87731a63475f8023)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:47.045714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.061837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754a73821e3749c5af5e8052765a6052'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.091917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754a73821e3749c5af5e8052765a6052'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.093156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754a73821e3749c5af5e8052765a6052'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.112609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-67ce3831-b162-4bd8-b8c2-61f9b06e3e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754a73821e3749c5af5e8052765a6052'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.121794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 988/1954] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/users/754a73821e3749c5af5e8052765a6052 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:47.162508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608f90331af547be87731a63475f8023'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.191933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608f90331af547be87731a63475f8023'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.220286 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608f90331af547be87731a63475f8023'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.221595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608f90331af547be87731a63475f8023'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.222549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608f90331af547be87731a63475f8023'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.267354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 967/1955] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:47 2022] DELETE /identity/v3/users/608f90331af547be87731a63475f8023 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:47.273374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.273965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.273965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.337612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:47.343399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.513659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 989/1956] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:47.526414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:47.528278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.644296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b16c56-ce84-4bed-b068-2d957db17f2e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:47.649038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:47.650223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.650706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.651176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.671104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:47.673378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd457-0e96-4c20-b617-c377542866e2 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.690783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 968/1957] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:48.049385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.051435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.069831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d5b7-1347-4ced-aeb3-ee20ec8c33fd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.092809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.093711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.096119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.096545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] PATH_INFO: `/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.098099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9d17ceacc143c5b3d759ab4a2e16bc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.100402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.183784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9d17ceacc143c5b3d759ab4a2e16bc', 'request_id': 'req-81571ecf-5bf7-4002-aedb-3921cb92a08e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.210436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9d17ceacc143c5b3d759ab4a2e16bc', 'request_id': 'req-81571ecf-5bf7-4002-aedb-3921cb92a08e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.221344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9d17ceacc143c5b3d759ab4a2e16bc', 'request_id': 'req-81571ecf-5bf7-4002-aedb-3921cb92a08e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.240358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.256661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] The token cache is being invalidate because project ca9d17ceacc143c5b3d759ab4a2e16bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:48.257052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.257880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-81571ecf-5bf7-4002-aedb-3921cb92a08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.262480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 990/1958] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/projects/ca9d17ceacc143c5b3d759ab4a2e16bc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:48.272134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.272619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.273104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.313939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.317933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.542662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.579848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 969/1959] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.594612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.596612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.597392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.637572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.639444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.661203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.665084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.671544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc911c3-0875-444f-9311-4ec220388799 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.677519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.678819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.679694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.680112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] PATH_INFO: `/v3/projects/75cffa46ecbd4892863888f7d6a73b54` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.681869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cffa46ecbd4892863888f7d6a73b54)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.690957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.692723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 991/1960] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.699628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.748493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70bada-8287-462d-aa8b-9bddbf068476 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.780399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.782961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.784863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.785239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.788903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:48.789488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.791433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.823673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 992/1961] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:48.838038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.862231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cffa46ecbd4892863888f7d6a73b54', 'request_id': 'req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.876930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008bd14-4d32-4bd2-aac1-79f9d4e2304c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.888327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cffa46ecbd4892863888f7d6a73b54', 'request_id': 'req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.906642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cffa46ecbd4892863888f7d6a73b54', 'request_id': 'req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.931847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] The token cache is being invalidate because project 75cffa46ecbd4892863888f7d6a73b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:48.932509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.934864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.937892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 970/1962] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/projects/75cffa46ecbd4892863888f7d6a73b54 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:48.943628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.946701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.041474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.042838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.043521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.044014 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.045350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.055497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.076715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e19e6-6873-4ab5-880f-5ccdeaf15c8e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.082553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.083950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.084544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.084995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] PATH_INFO: `/v3/users/dc0aea66609a4e3d802d0f302e471788` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.087381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0aea66609a4e3d802d0f302e471788)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.089595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.159113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 993/1963] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:49.159113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.159113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.201159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0aea66609a4e3d802d0f302e471788'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.220773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0aea66609a4e3d802d0f302e471788'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.237645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0aea66609a4e3d802d0f302e471788'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.239664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0aea66609a4e3d802d0f302e471788'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.241187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0aea66609a4e3d802d0f302e471788'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.276011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.287830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 971/1964] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/users/dc0aea66609a4e3d802d0f302e471788 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.289974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.294680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.299406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231be7ca-d65f-403e-b393-9e83765369bb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.418917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8445-38fe-4c46-a332-45cd2379cf56 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.427442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.428507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.429113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.429612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.430601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.431165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.432755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.433271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.433533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.433782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] PATH_INFO: `/v3/users/2540a2198e9c400fb9f8788626ef287b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.437650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2540a2198e9c400fb9f8788626ef287b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.442668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.463395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 972/1965] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:49.469511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.479657 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.493568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f47a9-073e-464b-8335-d5e4bc7bd6e9 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.503057 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.504384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.505096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.507260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.508258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.510018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.523226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 973/1966] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:49.531100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.548782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efa01-67d0-437f-ab84-0906428f0c4e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.558001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.558706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.558989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.559265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.560055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.562589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.563044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2540a2198e9c400fb9f8788626ef287b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.578445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2540a2198e9c400fb9f8788626ef287b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.586560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 974/1967] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:49.595670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.596767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2540a2198e9c400fb9f8788626ef287b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.597551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2540a2198e9c400fb9f8788626ef287b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.609083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c4add657-b400-4ede-b1d5-2c3aba3a7202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2540a2198e9c400fb9f8788626ef287b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.618960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 994/1968] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:49 2022] DELETE /identity/v3/users/2540a2198e9c400fb9f8788626ef287b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.625372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.625372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.625677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.627732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d0b3-ed15-486a-9b0a-eb854fb70ec6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.662164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:49.663658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.748489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.749765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.750248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.750959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] PATH_INFO: `/v3/projects/3c38e5a816be4f179254b4304f374e32/users/3aeb7b76ae034699ac8ba44aad4d4ebd/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.784639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c38e5a816be4f179254b4304f374e32, user_id=3aeb7b76ae034699ac8ba44aad4d4ebd, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.790334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.812825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 995/1969] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:49.827853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.829870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.839502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 975/1970] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:49 2022] PUT /identity/v3/projects/3c38e5a816be4f179254b4304f374e32/users/3aeb7b76ae034699ac8ba44aad4d4ebd/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.839502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.839502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.856920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631908f3-50e8-43ec-9379-c4c2eec3e99d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.935013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a3115-b03b-4769-b82e-717946674f43 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.943447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.948203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.948801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.949236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.956455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.977613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.979122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.979122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.979122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] PATH_INFO: `/v3/projects/fe25e52b60de4bca800178b6f04478e9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.980436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe25e52b60de4bca800178b6f04478e9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.982387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.043643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.074845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.075874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe25e52b60de4bca800178b6f04478e9', 'request_id': 'req-008b2d9e-685c-47f2-a264-9f04a1eca563'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:50.076690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b356-211c-4d36-8923-8c47616be367 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.105430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 976/1971] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:50.105652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe25e52b60de4bca800178b6f04478e9', 'request_id': 'req-008b2d9e-685c-47f2-a264-9f04a1eca563'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:50.107956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.108397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.108821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.128561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe25e52b60de4bca800178b6f04478e9', 'request_id': 'req-008b2d9e-685c-47f2-a264-9f04a1eca563'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:50.155953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] MFA Rules not processed for user `3aeb7b76ae034699ac8ba44aad4d4ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.157545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.162726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] The token cache is being invalidate because project fe25e52b60de4bca800178b6f04478e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:50.163072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:50.164365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-008b2d9e-685c-47f2-a264-9f04a1eca563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:50.169712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 996/1972] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:49 2022] DELETE /identity/v3/projects/fe25e52b60de4bca800178b6f04478e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:50.172792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f35-da2d-4e8d-a188-bc9e06daadde None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.174268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f35-da2d-4e8d-a188-bc9e06daadde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.174978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f35-da2d-4e8d-a188-bc9e06daadde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.239884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-39dc4f35-da2d-4e8d-a188-bc9e06daadde None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.242190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-39dc4f35-da2d-4e8d-a188-bc9e06daadde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.306959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 977/1973] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:50.309029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.318115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.446375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4fb8-4bc4-4ee0-beda-46e4ccb5a5b7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.453227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.454304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.454777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.455061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.456232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.458747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.480389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 997/1974] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:50.483396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.483841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.484206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.503250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 978/1975] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:50.506370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.509352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.511720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.560435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.677963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcffc7-dcc9-4f82-ad9b-412aec5cf7ab admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.690779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 998/1976] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:50.691930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.692433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.693133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.693410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.693765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.694695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.696709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.713089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d552a9-9c2d-4273-a01d-1b5adf3e94d6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.722086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.722923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.724005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.724317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.725181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:50.725501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.729178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.742004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 979/1977] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:50.745446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.747371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 999/1978] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:50.754530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.765614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8e6d-9fa3-401d-ab3d-6b71d80bd5a1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.769943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f001a44-f2b9-4cfc-b98c-247c56530f08 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.781049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.781865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.782070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.782347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.783088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.785311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.799541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 980/1979] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:50.800045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.800840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.801147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.801444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.802160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.803666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.804666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.818413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53548ce-6d9f-4141-abb3-ce57fd9fdb7b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.825802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.827224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.828589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.829281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] PATH_INFO: `/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10/users/58bbe182a202406296ac00e8515bd355/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.839831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1000/1980] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:50.844537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.870804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d811716c6d44eb19a1d6c2965c1bc10, user_id=58bbe182a202406296ac00e8515bd355, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.874559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.889471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.904073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 981/1981] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:50 2022] PUT /identity/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10/users/58bbe182a202406296ac00e8515bd355/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:50.910919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.950114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2bb0-b30b-460c-82a3-489889d71b4e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.018012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fd616-2e6a-41d7-b4ce-f140f9bf2a55 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.024900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.026281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.026610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.027710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.029115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.031280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.048109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.049256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.050533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.051280 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.051680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 982/1982] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:51.056266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.057166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.059203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.078810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbc0c-7126-49ce-9004-3f42693feeef admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.087520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.088850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.089283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.089743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] PATH_INFO: `/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10/users/58bbe182a202406296ac00e8515bd355/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.093412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d811716c6d44eb19a1d6c2965c1bc10, user_id=58bbe182a202406296ac00e8515bd355, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.099473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1001/1983] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:51.099666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.104527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.106698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.133950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 983/1984] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:51 2022] PUT /identity/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10/users/58bbe182a202406296ac00e8515bd355/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:51.135572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.160894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e3ea6-f10f-4d55-94a6-77cb0b0d2774 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.200466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.216090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8147a-f493-412d-be19-ee9f6ff7f200 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.226823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.227806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.228130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.228404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.229509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.231445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a2cc4-40db-4763-b14e-13f52e981c33 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.240393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.241299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.241585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.241860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] PATH_INFO: `/v3/projects/8cd392d0f6484ae78ca657d744d99963` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.243130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd392d0f6484ae78ca657d744d99963)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.245154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.245853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 984/1985] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:51.247875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039902-758f-4529-be34-9311a8324af6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.248304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039902-758f-4529-be34-9311a8324af6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.248722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039902-758f-4529-be34-9311a8324af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.285991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-46039902-758f-4529-be34-9311a8324af6 None None] MFA Rules not processed for user `58bbe182a202406296ac00e8515bd355`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:51.287242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-46039902-758f-4529-be34-9311a8324af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.304683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd392d0f6484ae78ca657d744d99963', 'request_id': 'req-f82cc29a-e8a7-430f-997b-52255e1f1a07'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.316819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd392d0f6484ae78ca657d744d99963', 'request_id': 'req-f82cc29a-e8a7-430f-997b-52255e1f1a07'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.324223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd392d0f6484ae78ca657d744d99963', 'request_id': 'req-f82cc29a-e8a7-430f-997b-52255e1f1a07'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.326704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.338683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] The token cache is being invalidate because project 8cd392d0f6484ae78ca657d744d99963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:51.339026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.340834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.343033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1002/1986] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:51 2022] DELETE /identity/v3/projects/8cd392d0f6484ae78ca657d744d99963 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:51.347637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.349202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.375437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 985/1987] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:51.377824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039902-758f-4529-be34-9311a8324af6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.379963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-46039902-758f-4529-be34-9311a8324af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.446623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc29a-e8a7-430f-997b-52255e1f1a07 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.454779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.455866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.456151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.456425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] PATH_INFO: `/v3/users/a0c948b89a7e4a7dbd1ce66030c16da7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.457869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c948b89a7e4a7dbd1ce66030c16da7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.460631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.463102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039902-758f-4529-be34-9311a8324af6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.468967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.469441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.469736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.470009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.470752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.472422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.486944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 986/1988] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:51.488141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.489883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.505890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf59de-b62d-4524-8243-a736308ee5b6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.511269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.512193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.512474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.512745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] PATH_INFO: `/v3/users/96d93ad9ff294b6a9d7937f1e8423423` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.513965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d93ad9ff294b6a9d7937f1e8423423)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.516054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.528660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c948b89a7e4a7dbd1ce66030c16da7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.538693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c948b89a7e4a7dbd1ce66030c16da7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.551880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c948b89a7e4a7dbd1ce66030c16da7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.552664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c948b89a7e4a7dbd1ce66030c16da7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.562253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c948b89a7e4a7dbd1ce66030c16da7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.569755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1003/1989] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:51 2022] DELETE /identity/v3/users/a0c948b89a7e4a7dbd1ce66030c16da7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:51.570592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.571989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.578925 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d93ad9ff294b6a9d7937f1e8423423'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.587478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d93ad9ff294b6a9d7937f1e8423423'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.597162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d93ad9ff294b6a9d7937f1e8423423'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.598232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d93ad9ff294b6a9d7937f1e8423423'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.598980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d93ad9ff294b6a9d7937f1e8423423'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:51.601408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.624068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 987/1990] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:51 2022] DELETE /identity/v3/users/96d93ad9ff294b6a9d7937f1e8423423 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:51.624068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.625704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.664262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69bfb-3098-48fc-b847-db34dd051d15 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.692529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.711175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95d3bc-e934-4018-aa54-d3f5db7b9257 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.717451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.718425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.718705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.719346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] PATH_INFO: `/v3/projects/ff925b8949d94c65aa0e8e4a61b4da20/users/1a06bf5aa84f4878ba348c260c92dcf9/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.727995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.728681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.728969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.729887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.731980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.739203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff925b8949d94c65aa0e8e4a61b4da20, user_id=1a06bf5aa84f4878ba348c260c92dcf9, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.742135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68f7e2-0bcf-48dc-935c-df64980217fe admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.760760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 988/1991] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:51 2022] PUT /identity/v3/projects/ff925b8949d94c65aa0e8e4a61b4da20/users/1a06bf5aa84f4878ba348c260c92dcf9/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:51.769087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.769527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.769770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.803058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:51.804397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.841880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.843823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070062-32e7-40ed-a2b9-83a3de67c1b9 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.859036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1004/1992] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:51.860593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.861035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.861321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.903432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] MFA Rules not processed for user `1a06bf5aa84f4878ba348c260c92dcf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:51.905301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.938290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 989/1993] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:51.946987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.949074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.056264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd64c60-0fff-46c6-91c8-e01d95317824 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.060440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.061289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.061689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.062038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.074231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.076033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.080854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1005/1994] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:52.081763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.083078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.090240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 990/1995] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:52.091220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.092815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.108870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fd3d2-63df-4222-bc25-c4935b634d80 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.115142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.116136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.116420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.116870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] PATH_INFO: `/v3/projects/7c7b73f011cd4464961c864bef79a4f1` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.118128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7b73f011cd4464961c864bef79a4f1)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.120342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.123548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:52.155846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d04cd-0beb-47b8-9f55-132bbc353fc5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.160441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.161261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.161506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.161765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.163790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.187420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:52.221408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7b73f011cd4464961c864bef79a4f1', 'request_id': 'req-f7772169-f16a-4561-b15d-40096027c759'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.230945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7b73f011cd4464961c864bef79a4f1', 'request_id': 'req-f7772169-f16a-4561-b15d-40096027c759'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.236025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.239136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.246291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7b73f011cd4464961c864bef79a4f1', 'request_id': 'req-f7772169-f16a-4561-b15d-40096027c759'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.255819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1006/1996] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:52.257101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.276138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188356a5-8ad9-4974-b6dd-7445caed6850 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.280338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] The token cache is being invalidate because project 7c7b73f011cd4464961c864bef79a4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:52.280968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.281978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f7772169-f16a-4561-b15d-40096027c759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.288809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 991/1997] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:52 2022] DELETE /identity/v3/projects/7c7b73f011cd4464961c864bef79a4f1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:52.290342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.290630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.290926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.317318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:52.319880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.361682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.362647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.363271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.363750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.364677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.368398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.416027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1007/1998] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:52.421053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.423960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.486988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 992/1999] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:52.488713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.491087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.516327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d6bc-54cc-4d5c-80f5-7aafea812bf6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.542117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa1968-11b3-41ab-8ff1-23d47a010745 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.549878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.550587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.550870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.551147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.552070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.554930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186430-ca67-4dec-b994-ae16a9e38fb9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.597435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.598752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.598752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.598972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] PATH_INFO: `/v3/projects/b98f5ba95fa34e318bec5f9c27c0d71f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.600640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98f5ba95fa34e318bec5f9c27c0d71f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.601197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1008/2000] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:52.603276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.603615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.603978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.606338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.636037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:52.637714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.661676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1009/2001] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:52.661676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.679088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c0c6-b802-4a4b-83ae-99e2f928d044 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.682093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:52.699729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98f5ba95fa34e318bec5f9c27c0d71f', 'request_id': 'req-b7af132a-4174-4c92-b71c-ac110f6a8b14'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.724745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98f5ba95fa34e318bec5f9c27c0d71f', 'request_id': 'req-b7af132a-4174-4c92-b71c-ac110f6a8b14'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.727366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:52.729868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98f5ba95fa34e318bec5f9c27c0d71f', 'request_id': 'req-b7af132a-4174-4c92-b71c-ac110f6a8b14'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.745133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] The token cache is being invalidate because project b98f5ba95fa34e318bec5f9c27c0d71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:52.745587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.746297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.748104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 993/2002] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:52 2022] DELETE /identity/v3/projects/b98f5ba95fa34e318bec5f9c27c0d71f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:52.748952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.750635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.776343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.777198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.777507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.777846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.778594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.780499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.793159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1010/2003] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:52.794222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.804146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.817427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9160-453e-4140-9fa5-376a1d5e5712 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.822631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.823574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.823855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.824133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] PATH_INFO: `/v3/users/3aeb7b76ae034699ac8ba44aad4d4ebd` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.825372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aeb7b76ae034699ac8ba44aad4d4ebd)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.827355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.841541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af132a-4174-4c92-b71c-ac110f6a8b14 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.847023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.847753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.848034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.848304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.849046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:52.849348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.851003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.872606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 994/2004] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:52.873477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.875769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.886177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aeb7b76ae034699ac8ba44aad4d4ebd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.889470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567b78d-d684-41c4-9c7a-b2c7d42a4758 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.895330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aeb7b76ae034699ac8ba44aad4d4ebd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.895673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.896625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.896941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.897239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] PATH_INFO: `/v3/users/9ad39ea8ce414ae894e32b47a09a84c3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.898496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad39ea8ce414ae894e32b47a09a84c3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.900771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.910720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aeb7b76ae034699ac8ba44aad4d4ebd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.911513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aeb7b76ae034699ac8ba44aad4d4ebd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.919421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aeb7b76ae034699ac8ba44aad4d4ebd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.926804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1011/2005] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:52 2022] DELETE /identity/v3/users/3aeb7b76ae034699ac8ba44aad4d4ebd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:52.927989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.930700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.977355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad39ea8ce414ae894e32b47a09a84c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.989053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad39ea8ce414ae894e32b47a09a84c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.000717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad39ea8ce414ae894e32b47a09a84c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.001442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad39ea8ce414ae894e32b47a09a84c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.002224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad39ea8ce414ae894e32b47a09a84c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.013227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516500cd-b992-404a-84fd-d4c622bee43d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.018614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.019381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.019663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.020060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.020803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.022452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867437cd-67b3-4b2e-b688-d86131d60b3f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.026557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 995/2006] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:52 2022] DELETE /identity/v3/users/9ad39ea8ce414ae894e32b47a09a84c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:53.032053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.036131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.039420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1012/2007] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:53.050350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.050678 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.050916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.077529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:53.078834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.080115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.116595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.122019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df00b-614f-4ae2-a46e-39a8e9736671 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.128449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.129160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.129439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.129708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.130422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.132741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.155792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1013/2008] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.156664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.158079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.170221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 996/2009] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:53.171136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.171338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d30f5-ebea-4467-81a2-6c9f3ac2f961 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.172926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.244726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd20c-76b0-477f-8c34-f2680deee36e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.246771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.247958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.248406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.248864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.249055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] PATH_INFO: `/v3/projects/f58751e3ef804214b9fedacafa7cf76b/users/2911ce76265c45ab98993a8ef191ca18/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.249769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.250053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.250330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.277103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.278508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.295832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 997/2010] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:53.296756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.301354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58751e3ef804214b9fedacafa7cf76b, user_id=2911ce76265c45ab98993a8ef191ca18, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.304370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60353-b566-4fcc-a225-68ef6e06d6ba admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.319290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0eb7-121d-40ed-b30e-ccff8a0d2459 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.330013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1014/2011] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:53 2022] PUT /identity/v3/projects/f58751e3ef804214b9fedacafa7cf76b/users/2911ce76265c45ab98993a8ef191ca18/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:53.352968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.352968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.352968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.396094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] MFA Rules not processed for user `2911ce76265c45ab98993a8ef191ca18`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:53.397435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.434508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.435108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.436365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.436667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.438002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.440707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.469442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 998/2012] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:53.473420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.494136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1286fc-f7ca-4e69-9317-119d36e92203 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.505039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.509050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.509480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.511276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.512452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.514135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.514483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1015/2013] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.515595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.517733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.533000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 999/2014] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:53.533000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.549013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec45c8-04e2-4910-ae00-ae5b393de980 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.553181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf0efd-a280-4039-b19c-a96032c582d4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.556895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.557594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.557868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.558140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.558913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.561137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.562569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.564231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.564728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.565070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] PATH_INFO: `/v3/projects/4b870d98b28546a8acf6f936ba57032b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.567106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b870d98b28546a8acf6f936ba57032b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.569306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.600376 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1000/2015] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:53.601194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.620089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.654427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.668115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b870d98b28546a8acf6f936ba57032b', 'request_id': 'req-b27d6388-4ea3-476e-b1f7-dcf329284f55'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.686968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b870d98b28546a8acf6f936ba57032b', 'request_id': 'req-b27d6388-4ea3-476e-b1f7-dcf329284f55'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.702237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b870d98b28546a8acf6f936ba57032b', 'request_id': 'req-b27d6388-4ea3-476e-b1f7-dcf329284f55'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.716372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] The token cache is being invalidate because project 4b870d98b28546a8acf6f936ba57032b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:53.716668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.717349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.718966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1016/2016] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:53 2022] DELETE /identity/v3/projects/4b870d98b28546a8acf6f936ba57032b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:53.719834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.727390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.749060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303546-83d7-4b5e-9d22-7970204c0dcd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.842020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.842763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.843055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.843355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.844348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.845967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b5426-1a77-48df-b64c-e1edd6bc077b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.851854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d6388-4ea3-476e-b1f7-dcf329284f55 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.857055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1001/2017] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:53.857617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.858674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.858973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.859131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.859249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.859664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.860182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.860544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.863073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.880975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:53.882424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.893614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1017/2018] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:53.893812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1002/2019] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.893936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.894025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.894025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.896030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.906238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602faca-857c-4280-b228-62b249f8bc0c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.911089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601641b-e847-4ba7-bf96-4edbff4db3c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.913257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.914725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.915234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.915627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.915873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] PATH_INFO: `/v3/projects/39f5704379dc4ab2a300a422ad010ee9/users/a948eb85036347b890baacc1b513c93e/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.916525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.916824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.917103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] PATH_INFO: `/v3/projects/3c38e5a816be4f179254b4304f374e32` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.918320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c38e5a816be4f179254b4304f374e32)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.920370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.936684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f5704379dc4ab2a300a422ad010ee9, user_id=a948eb85036347b890baacc1b513c93e, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.940430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.958894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1003/2020] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:53 2022] PUT /identity/v3/projects/39f5704379dc4ab2a300a422ad010ee9/users/a948eb85036347b890baacc1b513c93e/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:53.959774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.985288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c38e5a816be4f179254b4304f374e32', 'request_id': 'req-e0a3b483-411c-49af-a68a-2ce7e54d7b86'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.994222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c38e5a816be4f179254b4304f374e32', 'request_id': 'req-e0a3b483-411c-49af-a68a-2ce7e54d7b86'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.002256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c38e5a816be4f179254b4304f374e32', 'request_id': 'req-e0a3b483-411c-49af-a68a-2ce7e54d7b86'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.014571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] The token cache is being invalidate because project 3c38e5a816be4f179254b4304f374e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:54.014848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.015542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e0a3b483-411c-49af-a68a-2ce7e54d7b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.017263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1018/2021] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:53 2022] DELETE /identity/v3/projects/3c38e5a816be4f179254b4304f374e32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.018573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aca68-687f-4bd3-bfa7-be9502bde60a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.018858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aca68-687f-4bd3-bfa7-be9502bde60a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.019129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aca68-687f-4bd3-bfa7-be9502bde60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.036946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1f4aca68-687f-4bd3-bfa7-be9502bde60a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:54.038157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1f4aca68-687f-4bd3-bfa7-be9502bde60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.040096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f17e-d3d2-423f-a637-470f6c078192 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.070864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.077571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.100467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1019/2022] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:54.101972 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.102332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.102619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.104413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.105179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.105520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.105796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.106531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.108392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.122750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1004/2023] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:54.122750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.122750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.134135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] MFA Rules not processed for user `a948eb85036347b890baacc1b513c93e`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:54.134740 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006a4-bd24-41f9-9c42-ca9a4df2b29b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.135378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.139434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.140314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.140596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.140871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] PATH_INFO: `/v3/users/58bbe182a202406296ac00e8515bd355` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.142152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bbe182a202406296ac00e8515bd355)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.144123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.194386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bbe182a202406296ac00e8515bd355'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.201617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bbe182a202406296ac00e8515bd355'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.204736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1020/2024] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:54.205595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.213127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bbe182a202406296ac00e8515bd355'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.213761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bbe182a202406296ac00e8515bd355'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.214433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bbe182a202406296ac00e8515bd355'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.217606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2c90-5575-4e8e-a3fa-4e0c629397cc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.222211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.223029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.223629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.223744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.224474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:54.224776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.226400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.233624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1005/2025] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:54 2022] DELETE /identity/v3/users/58bbe182a202406296ac00e8515bd355 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.234523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.236041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.248340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1021/2026] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:54.248941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.251096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.267089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d153d6-1310-47c4-bd46-c734349000aa admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.327659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085d25-eaa9-42bc-88e9-9d73e9aa813b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.334613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.336389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.336627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.336910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] PATH_INFO: `/v3/projects/b0ccd80e45b94458844ea2ba161940ab/users/b469e5231d6b4e6a9289a10498d74fb4/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.337502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.338237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.338525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.338806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.339602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.341679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.358711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ccd80e45b94458844ea2ba161940ab, user_id=b469e5231d6b4e6a9289a10498d74fb4, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.362879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.382016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1006/2027] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:54 2022] PUT /identity/v3/projects/b0ccd80e45b94458844ea2ba161940ab/users/b469e5231d6b4e6a9289a10498d74fb4/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.385564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.387513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.392165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1022/2028] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:54.393772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.430163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.484261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.491641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d380-221e-4105-a887-4ec934ce433d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.520575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc708-4999-40eb-9a6c-9c7231f89d4d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.539445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.540273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.540629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.540976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.541978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.543638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.565826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1023/2029] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:54.566827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.578498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019c90-fa3a-4540-a67c-0f9c85e7f147 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.585223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.586264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.586755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.587273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.588762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.591016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.604344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.606785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.608121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.609249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.610480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.612837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.630081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1024/2030] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/users => generated 301 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:54.631104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.646882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921289a-5880-4479-b485-1f113d32a135 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.652049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.656116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.657562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.658728 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] PATH_INFO: `/v3/projects/b0ccd80e45b94458844ea2ba161940ab/users/b469e5231d6b4e6a9289a10498d74fb4/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.666565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ccd80e45b94458844ea2ba161940ab, user_id=b469e5231d6b4e6a9289a10498d74fb4, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.673484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1007/2031] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:54.674331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.674709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.695388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1025/2032] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:54 2022] PUT /identity/v3/projects/b0ccd80e45b94458844ea2ba161940ab/users/b469e5231d6b4e6a9289a10498d74fb4/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.696897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.776710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f08c-a276-48be-9af7-37084661ca7e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.797039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b6f5-6479-4ea5-b424-530df3f49d09 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.802283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.802980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.803263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.803604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.804300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.806812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46142f-e838-4e25-ac40-0ec26478847f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.850459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1026/2033] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:54.852081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.852374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.853058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.887117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] MFA Rules not processed for user `b469e5231d6b4e6a9289a10498d74fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:54.888910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.906970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.907628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.907908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.908641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.909778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.911933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.928178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.940263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1008/2034] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:54.942303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.945876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.970088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb2ee-35da-4018-9f3e-4c2c9f41e73d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.975553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.976426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.976756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.977184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] PATH_INFO: `/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.978618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d811716c6d44eb19a1d6c2965c1bc10)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.980907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.003402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1027/2035] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.004554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.016888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d146-1a67-420d-bc03-79d59d94d2ae None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.028486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.029285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.031615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.032296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.033035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.039123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.063325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d811716c6d44eb19a1d6c2965c1bc10', 'request_id': 'req-2a467aba-7adb-4601-9581-3333459b7956'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:55.067069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1028/2036] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:55.070951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.074499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d811716c6d44eb19a1d6c2965c1bc10', 'request_id': 'req-2a467aba-7adb-4601-9581-3333459b7956'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:55.090098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2458fa-1c5c-49a5-a3db-25dca2b94e7c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.090796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d811716c6d44eb19a1d6c2965c1bc10', 'request_id': 'req-2a467aba-7adb-4601-9581-3333459b7956'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:55.101637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.128220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] The token cache is being invalidate because project 0d811716c6d44eb19a1d6c2965c1bc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:55.129777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:55.132864 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:55.141742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1009/2037] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:54 2022] DELETE /identity/v3/projects/0d811716c6d44eb19a1d6c2965c1bc10 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:55.141742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.144954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.174662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.176135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.176648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.176999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] PATH_INFO: `/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817/users/0f787d6f0af24af6a6971041d174b3b7/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.207601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed8ed3dfe8244d5b63566f6a1b93817, user_id=0f787d6f0af24af6a6971041d174b3b7, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.210531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.232604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1029/2038] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:55 2022] PUT /identity/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817/users/0f787d6f0af24af6a6971041d174b3b7/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:55.233372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.235818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.272112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a467aba-7adb-4601-9581-3333459b7956 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.330070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d33e8-f5f0-40df-b836-f94fc286e9d8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.342141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.343414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.343767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.344221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.344779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.345326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.346114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.346579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.346855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.347638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8037c8-6950-45db-899b-c1fee2e046b4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.349674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.364712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1030/2039] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:55.366639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.367032 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.377746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.400912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.402204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.415671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1031/2040] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.424224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.425776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.450104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8658af9-965a-4562-881a-332aa698ac07 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.455851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.456543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.456828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.457099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.458094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.459750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.466588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.470888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.476139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31242f1-2dc7-4501-a1bf-cdfba174e19d service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.476318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1032/2041] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:55.476318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.487150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1010/2042] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:55.488324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049ce3-57fc-4a96-8464-b196ce4cf062 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.489530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.490110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.490458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.494643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.495496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.495904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.496408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] PATH_INFO: `/v3/projects/63d181702776465583efff4f48a96d4c/users/9976d1108fe3494f87360d49620871f3/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.516586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d181702776465583efff4f48a96d4c, user_id=9976d1108fe3494f87360d49620871f3, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.518998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.519830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.521015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.542205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1011/2043] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.544611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.547367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1033/2044] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:55 2022] PUT /identity/v3/projects/63d181702776465583efff4f48a96d4c/users/9976d1108fe3494f87360d49620871f3/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:55.548934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.568094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77d46d-d3b7-4182-8ca2-596deed88da2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.642806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.659660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537967e-0878-4288-9ef7-ce87b7184ba0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.666361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.667402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.667722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.667995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.669016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:55.669398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.671818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266fac-5aeb-411b-a1d5-b504f1e76062 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.687372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.694116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.694116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.694116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] PATH_INFO: `/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817/users/0f787d6f0af24af6a6971041d174b3b7/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.698361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1034/2045] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:55.698361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15d33-9002-4b1f-8bc2-7fbbe923453e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.698361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15d33-9002-4b1f-8bc2-7fbbe923453e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.698361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15d33-9002-4b1f-8bc2-7fbbe923453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.699079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed8ed3dfe8244d5b63566f6a1b93817, user_id=0f787d6f0af24af6a6971041d174b3b7, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.700991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.721255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1012/2046] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:55 2022] PUT /identity/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817/users/0f787d6f0af24af6a6971041d174b3b7/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:55.722219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.748948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bde15d33-9002-4b1f-8bc2-7fbbe923453e None None] MFA Rules not processed for user `9976d1108fe3494f87360d49620871f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.751004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bde15d33-9002-4b1f-8bc2-7fbbe923453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.838465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695501-34ed-4344-88f3-d72398cfc6fb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.846263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.847160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.847434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.847563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.848265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.850303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.872540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1035/2047] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.887790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.888934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.889214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.941840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1013/2048] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:55.941840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.945782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] MFA Rules not processed for user `0f787d6f0af24af6a6971041d174b3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.947976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.007178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401072b-1dd6-48bd-8793-cdca642936cf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.011067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.012128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.012626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.012894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.038806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1036/2049] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:56.039685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.047187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:56.099053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.103759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.119059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1014/2050] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:56.120053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.121656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.122631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13976c-f6e0-4d9e-bb19-f819b78244ba None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.128968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.129969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.130259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.130534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.131426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.134143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.139553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579771b-5e08-4c7d-8a46-4495118bc817 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.143859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.144333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:56.151709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.152266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.152718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.168411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1037/2051] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:56.169405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.170167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.171986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.181469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b25be-d7ab-4b05-9bf2-d5c8e0afcbee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.186198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1015/2052] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:56.187605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.192472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.193852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.194312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.195864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] PATH_INFO: `/v3/users/9976d1108fe3494f87360d49620871f3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.197929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9976d1108fe3494f87360d49620871f3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.199818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a8dd-0f7d-46d8-81ce-16816220710c service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.201345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.206579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.207422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.207901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.208245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.209276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.210849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.226545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1016/2053] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:56.227681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.240405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02855-a6c2-44a7-addb-8d03b9b3596b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.248648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.249316 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.249596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.253214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.253214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.257000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.273481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1017/2054] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:56.274571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.286105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dec50-6ece-42ec-b4bc-880d4180f2d8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.288319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9976d1108fe3494f87360d49620871f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.291905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.292910 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.293413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.293717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] PATH_INFO: `/v3/projects/a57e9bb98bbf4d36bcf16ef6f33a8a59/users/8e0c51aa56114ba6ae8fafd9c57c5f93/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.302792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9976d1108fe3494f87360d49620871f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.322696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9976d1108fe3494f87360d49620871f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.323334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9976d1108fe3494f87360d49620871f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.323456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57e9bb98bbf4d36bcf16ef6f33a8a59, user_id=8e0c51aa56114ba6ae8fafd9c57c5f93, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.326146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658e69c-8a05-413e-b4ea-df49766adf8f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.332587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9976d1108fe3494f87360d49620871f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.341465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1038/2055] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:56 2022] DELETE /identity/v3/users/9976d1108fe3494f87360d49620871f3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:56.344353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1018/2056] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:56 2022] PUT /identity/v3/projects/a57e9bb98bbf4d36bcf16ef6f33a8a59/users/8e0c51aa56114ba6ae8fafd9c57c5f93/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:56.354886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.355705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa75-28b5-42e8-8ca7-357324fc0c35 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.356619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa75-28b5-42e8-8ca7-357324fc0c35 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.356732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.356969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa75-28b5-42e8-8ca7-357324fc0c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.376444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ed46aa75-28b5-42e8-8ca7-357324fc0c35 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:56.378903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ed46aa75-28b5-42e8-8ca7-357324fc0c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.457853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16da778-51a1-48e2-a0d6-8ce74e57599e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.463622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.464590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.465090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.465887 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] PATH_INFO: `/v3/users/a948eb85036347b890baacc1b513c93e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.467431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a948eb85036347b890baacc1b513c93e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.469554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.497933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1019/2057] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:56.501609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e435b-b41c-447d-afa8-cfe851542156 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.501609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e435b-b41c-447d-afa8-cfe851542156 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.501609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e435b-b41c-447d-afa8-cfe851542156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.543986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a65e435b-b41c-447d-afa8-cfe851542156 None None] MFA Rules not processed for user `8e0c51aa56114ba6ae8fafd9c57c5f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:56.545280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a65e435b-b41c-447d-afa8-cfe851542156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.550333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a948eb85036347b890baacc1b513c93e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.563799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a948eb85036347b890baacc1b513c93e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.574358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=5,keystone:SELECT=76,keystone:DELETE=19 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:56.586691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a948eb85036347b890baacc1b513c93e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.587694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a948eb85036347b890baacc1b513c93e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.602446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a948eb85036347b890baacc1b513c93e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:56.615696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1039/2058] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:56 2022] DELETE /identity/v3/users/a948eb85036347b890baacc1b513c93e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:56.616952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.618296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.630034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:56.665625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1020/2059] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:56.666729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.667025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.667322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.686107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:56.687405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.712108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468587cc-0400-4293-8a81-4fb6bf2d22ee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.716119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.716995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.717169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.717383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.719243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.766069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1021/2060] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:56.767412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.768978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:56.787692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.788716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57babf-25e9-440d-805a-49ebf9ad4f35 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.790094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.793915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.794722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.795063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.795610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.796401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.798444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.802390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1040/2061] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:56.803618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.813602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb969b3f-717d-436b-801d-2256f4257c2e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.818811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.819957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.820454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.820939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.835961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.837808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.847070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1022/2062] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:56.850634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:56.854630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1041/2063] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:56.930426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf96c-1bd1-4856-bb46-c689bc6a8405 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:56.945300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:56.948041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:56.949464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:56.950010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:56.951767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:56.956593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:56.995892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1023/2064] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:56 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:57.000586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.014821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcec9-265b-482e-97b0-48f34869b1a4 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.022030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.023739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.024396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.024503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.025696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.028707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.052450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.065311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1042/2065] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:57.069505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944cac5-c2ba-47b0-94dd-23f64f498806 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.094450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.095411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.095701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.096628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] PATH_INFO: `/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299/users/9143589cd48e489e8771f1a198d63d2d/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.118015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3733e1c16f0e4e4c8605c2efa9f03299, user_id=9143589cd48e489e8771f1a198d63d2d, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.120783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.154391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1024/2066] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:57 2022] PUT /identity/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299/users/9143589cd48e489e8771f1a198d63d2d/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:57.160081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.193029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0ea0-90d4-43fb-9fce-4cb7096a5c2d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.296953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.297903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.298183 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.298580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.299638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.301427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.320727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1043/2067] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:57.324825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.339269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637306fc-cf1c-434f-a670-2c087f146fb3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.345441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.346726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.347179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.347737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.348183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] PATH_INFO: `/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299/users/9143589cd48e489e8771f1a198d63d2d/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.350470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3733e1c16f0e4e4c8605c2efa9f03299, user_id=9143589cd48e489e8771f1a198d63d2d, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.351701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.353859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.378713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:57.386442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e2925-2b34-48aa-bb69-6140de18fc25 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.421813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1025/2068] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:57 2022] PUT /identity/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299/users/9143589cd48e489e8771f1a198d63d2d/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:57.422876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.424942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.492038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:57.511091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.512140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.512452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.512939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] PATH_INFO: `/v3/projects/63d181702776465583efff4f48a96d4c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.514727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d181702776465583efff4f48a96d4c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.517752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.558499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38949-0fc3-4acc-8414-8ab6d14cb380 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.563576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.564336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.564597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.564876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.566819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.618805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d181702776465583efff4f48a96d4c', 'request_id': 'req-f6021dd0-1c65-4a1e-8303-57a36d8644f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.629652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d181702776465583efff4f48a96d4c', 'request_id': 'req-f6021dd0-1c65-4a1e-8303-57a36d8644f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.638485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d181702776465583efff4f48a96d4c', 'request_id': 'req-f6021dd0-1c65-4a1e-8303-57a36d8644f3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.652623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.653887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.657081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] The token cache is being invalidate because project 63d181702776465583efff4f48a96d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:57.657380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.658211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6021dd0-1c65-4a1e-8303-57a36d8644f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.660217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1044/2069] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:57 2022] DELETE /identity/v3/projects/63d181702776465583efff4f48a96d4c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:57.661474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c95ef-5311-4ca6-a379-2d894486b905 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.661941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c95ef-5311-4ca6-a379-2d894486b905 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.662222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c95ef-5311-4ca6-a379-2d894486b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.667754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1026/2070] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:57.668873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.671040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.686693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb357-7390-471b-ba82-7143edc00bb6 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:57.702187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-133c95ef-5311-4ca6-a379-2d894486b905 None None] MFA Rules not processed for user `9143589cd48e489e8771f1a198d63d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:57.704055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-133c95ef-5311-4ca6-a379-2d894486b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.760131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:57.762585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.763078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.763654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] PATH_INFO: `/v3/projects/39f5704379dc4ab2a300a422ad010ee9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.765418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f5704379dc4ab2a300a422ad010ee9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:57.768045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:57.831102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f5704379dc4ab2a300a422ad010ee9', 'request_id': 'req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.840818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f5704379dc4ab2a300a422ad010ee9', 'request_id': 'req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.854201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1045/2071] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:57.856147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:57.856512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:57.856836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:57.867197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f5704379dc4ab2a300a422ad010ee9', 'request_id': 'req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.883517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] The token cache is being invalidate because project 39f5704379dc4ab2a300a422ad010ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:57.884173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.885100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:57.888955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1027/2072] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:57 2022] DELETE /identity/v3/projects/39f5704379dc4ab2a300a422ad010ee9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:57.890320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:57.894817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.908137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:57.913863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:57.917389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:57.944067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:57.991689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9112c-cd09-4d49-9908-9ffa8d8d355e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.001086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.001788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.002070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.002347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.005104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:58.066889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1046/2073] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:58.066889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.069453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:58.090591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf4d2b-fb49-4e68-913d-5fa96f171bb4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.100471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.101466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.101750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.102024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] PATH_INFO: `/v3/users/0f787d6f0af24af6a6971041d174b3b7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.111460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f787d6f0af24af6a6971041d174b3b7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.113766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.137067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.138780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b36f-119a-4dbf-8ea3-83eeac1b1173 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.163112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1028/2074] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:58.165867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.166160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.166439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.197304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:58.198693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:58.208870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1029/2075] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:58.214034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.217375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f787d6f0af24af6a6971041d174b3b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:58.226338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb8f1d-de5e-4e9b-b81c-baaf91840416 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.231906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.233107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.234046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.234240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.235025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:58.235386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.237303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.240721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f787d6f0af24af6a6971041d174b3b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:58.263509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1030/2076] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:58.267300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.274383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f787d6f0af24af6a6971041d174b3b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:58.284522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f787d6f0af24af6a6971041d174b3b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:58.295252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5175-c6f6-4b42-a0f7-cd16cf17ac55 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.306526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f787d6f0af24af6a6971041d174b3b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:58.308445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.310112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.311076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.311946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.313810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.320049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.328722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1047/2077] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:58 2022] DELETE /identity/v3/users/0f787d6f0af24af6a6971041d174b3b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:58.427713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.429356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:58.429636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1031/2078] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:58.602414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c67505-4fb2-428d-97e5-7845ddf317ee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.771754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.780648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:58.789360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:58.835672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.836399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.836680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.836965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.837687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.839781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.884353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1048/2079] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:58 2022] POST /identity/v3/users => generated 286 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:58.891271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.916804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e0ac-2aaf-471d-a3c6-59afd226af06 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:58.935023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:58.936437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:58.936809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:58.937059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:58.938394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:58.941474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:58.979763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1049/2080] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:58.981063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:58.987112 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.015620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d450d-aaf9-4699-8170-a6b641ed008e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.028896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.030226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.030513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.030788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] PATH_INFO: `/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.032581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed8ed3dfe8244d5b63566f6a1b93817)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.035515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.072222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:59.088730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d5d76-1325-43de-8960-d1afe0fe7d5b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.093409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.094200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.094596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.098373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.100590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.126738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed8ed3dfe8244d5b63566f6a1b93817', 'request_id': 'req-5ae61197-3199-47eb-8de7-48e1845dc49c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:59.136886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed8ed3dfe8244d5b63566f6a1b93817', 'request_id': 'req-5ae61197-3199-47eb-8de7-48e1845dc49c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:59.153075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed8ed3dfe8244d5b63566f6a1b93817', 'request_id': 'req-5ae61197-3199-47eb-8de7-48e1845dc49c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:59.170085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] The token cache is being invalidate because project bed8ed3dfe8244d5b63566f6a1b93817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:59.170570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:59.171622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:59.173894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1032/2081] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:58 2022] DELETE /identity/v3/projects/bed8ed3dfe8244d5b63566f6a1b93817 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:59.174894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.178009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.180113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.181749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e43d1-40e1-4562-99a3-59144fc71a2f service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.197592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1050/2082] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:59.199045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d513-43ab-4fc0-8ced-1719e88ba676 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.199368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d513-43ab-4fc0-8ced-1719e88ba676 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.199654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d513-43ab-4fc0-8ced-1719e88ba676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.220371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e049d513-43ab-4fc0-8ced-1719e88ba676 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:59.221598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e049d513-43ab-4fc0-8ced-1719e88ba676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.341554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae61197-3199-47eb-8de7-48e1845dc49c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.350539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.351802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.351802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.352058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.352636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.354527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.398194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1033/2083] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:59.402133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1051/2084] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:59.402540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.410364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.410659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.410936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.425208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:59.426525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c82ef-f0cb-4947-a1d0-f52e33036baf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.431988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:59.434434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.435012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.436253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.436721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.437098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] PATH_INFO: `/v3/projects/05fb1dca17214408b5afda6b4a58d755/users/e1de96ea379c44498651f6efb46bf81c/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.443751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1052/2085] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:59.447825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.456219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fb1dca17214408b5afda6b4a58d755, user_id=e1de96ea379c44498651f6efb46bf81c, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.457450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb1d51-7995-4a6e-a8bc-50f58e854e9a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.459021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60849cf-da23-4da2-8fdc-6abadbc01c67 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.462870 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.463067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.463389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.463664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.464399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:59.464718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.466344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.478751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1053/2086] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:59.483751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.489348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1034/2087] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:59 2022] PUT /identity/v3/projects/05fb1dca17214408b5afda6b4a58d755/users/e1de96ea379c44498651f6efb46bf81c/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:59.493803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604af9-4cc5-490c-ad29-1157c4cf92b2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.499707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.499992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.500264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.527550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] MFA Rules not processed for user `e1de96ea379c44498651f6efb46bf81c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:59.528935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.552818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.553598 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.553881 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.554152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.554844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.556884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.585502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1054/2088] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:59.589940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.605004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1035/2089] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:59.621075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.623611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:59.646717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:59.677700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc882ab-7db7-4880-ab5c-d1d6cb7a011d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.684305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.685298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.685726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.686141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.687026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.689330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.714125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bcfab-684c-464d-88ec-7b1bb877ba2b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.722396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1055/2090] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:59.727111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.738793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d8c3-2ca9-41f4-99cd-2fd1384197b0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.744919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.745796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.746105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.746384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.747122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.749748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.763357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1056/2091] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:59.765890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.781688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020481-b3bd-43e1-b8a3-901ab72e43a7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.788436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.789440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.789904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.790376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.791460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.793578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.794435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.795666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.795849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.796189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.809804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1057/2092] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:59.814267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.828240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07b30c-e314-41dc-ad4b-90859fd599b4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:59.837289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:59.838714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.838988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.839453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] PATH_INFO: `/v3/projects/7cc89545a373489a9316846fb571b920/users/81efa8a82f2d4edaae7c84346b13aa49/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.862254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc89545a373489a9316846fb571b920, user_id=81efa8a82f2d4edaae7c84346b13aa49, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.867874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.876707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:59.878984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad9104-228e-4db1-8ea4-fabbfb329c75 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:59.895370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1036/2093] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:59.899481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1058/2094] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:59 2022] PUT /identity/v3/projects/7cc89545a373489a9316846fb571b920/users/81efa8a82f2d4edaae7c84346b13aa49/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:59.918318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:59.920162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:59.920944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:59.922453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:59.948233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:59.958328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] MFA Rules not processed for user `81efa8a82f2d4edaae7c84346b13aa49`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:59.959688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:00.006392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336079-c422-457e-b7da-d028ae9bad48 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:00.011268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:00.012203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:00.012489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:00.012764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] PATH_INFO: `/v3/users/e1de96ea379c44498651f6efb46bf81c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:00.014171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1de96ea379c44498651f6efb46bf81c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:00.016834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:00.040552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1037/2095] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:00.054829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:00.082948 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:00.084880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1de96ea379c44498651f6efb46bf81c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:00.093846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1de96ea379c44498651f6efb46bf81c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:00.118659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1de96ea379c44498651f6efb46bf81c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:00.119840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1de96ea379c44498651f6efb46bf81c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:00.129803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ec74fdc3-ed60-452d-8716-ecbfa6378e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1de96ea379c44498651f6efb46bf81c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:00.153063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1059/2096] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:59 2022] DELETE /identity/v3/users/e1de96ea379c44498651f6efb46bf81c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:00.153649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe762f20-6e55-4a38-8945-a32f99baebea None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:00.153998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:00.154353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:00.155205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:00.180529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:00.182635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:00.210790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:00.210790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:00.211348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:00.211494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:00.213718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:00.271692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1060/2097] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:00.278781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:00.281026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:00.312132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:00.316293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:00.332342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1038/2098] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:26:00.341038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:00.374906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ce4b-0608-4a91-8d99-a83ae7cb32ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:00.381470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:00.382531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:00.383162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:00.383692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:00.405147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:00.408197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453eea1-1b17-4f17-a037-34f8d22a63dc service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:00.430756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1061/2099] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:01.065105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.067540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:01.097652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20501-59dc-4085-95b5-ef9baa1723bb service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.106594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.107235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.108165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.108165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] PATH_INFO: `/v3/projects/05fb1dca17214408b5afda6b4a58d755` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.109867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fb1dca17214408b5afda6b4a58d755)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.115038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.170895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fb1dca17214408b5afda6b4a58d755', 'request_id': 'req-703a9587-847a-47aa-8369-d90f2c8bc1a0'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:01.178515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fb1dca17214408b5afda6b4a58d755', 'request_id': 'req-703a9587-847a-47aa-8369-d90f2c8bc1a0'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:01.187195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fb1dca17214408b5afda6b4a58d755', 'request_id': 'req-703a9587-847a-47aa-8369-d90f2c8bc1a0'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:01.201245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] The token cache is being invalidate because project 05fb1dca17214408b5afda6b4a58d755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:01.201527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:01.202439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-703a9587-847a-47aa-8369-d90f2c8bc1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:01.204739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1039/2100] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:01 2022] DELETE /identity/v3/projects/05fb1dca17214408b5afda6b4a58d755 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:01.210814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.211413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.211413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.235563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:01.236812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:01.310361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1062/2101] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:01.323972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.325487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.325935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.335448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:01.353420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:01.355389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:01.367112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1040/2102] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:01.372146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.384441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096fc3f-60c5-479a-9521-ac76df5a7f0d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.390375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.391156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.391479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.391750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.392488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:01.392788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.394411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.407952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1063/2103] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:01.413139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.423140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2acb-a1f6-4d52-aa50-318d4e36ce40 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.429043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.429762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.430064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.430321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.431159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.433348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.462595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1041/2104] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:01 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:01.466760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.477941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68297f7-da51-4f60-a553-7691003be3f5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.542513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.543257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.543628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.543956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.544982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.546942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.568275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1064/2105] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:01 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:01.572944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.584191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9616f4-e208-4bb1-8923-32fddd43b2e4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.589555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.590238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.590516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.590786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.591650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.593199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.605847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1042/2106] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:01.610233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.623794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b5afc-9209-4d6c-980a-514470ef83d7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.631455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.632415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.632893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.633056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.634108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.636247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ecb4f-a3de-4e1a-806c-9c7448eb2746 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.651721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1065/2107] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:01.657621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.669384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841216-d029-4608-b411-f51ca47af233 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.674903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.675756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.676036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.676522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] PATH_INFO: `/v3/projects/023ee7b2cb3e4253a75593a4808b33ad/users/5354b3376a424abdaa0427a7eb5aece1/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.695486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ee7b2cb3e4253a75593a4808b33ad, user_id=5354b3376a424abdaa0427a7eb5aece1, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.698450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:01.716106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1043/2108] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:01 2022] PUT /identity/v3/projects/023ee7b2cb3e4253a75593a4808b33ad/users/5354b3376a424abdaa0427a7eb5aece1/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:01.727235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.727692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.728104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.758714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] MFA Rules not processed for user `5354b3376a424abdaa0427a7eb5aece1`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:01.759980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:01.802565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:01.864142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1066/2109] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:01.876842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:01.879152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:01.971427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b47e-0474-4518-8b66-f666e8adf046 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:01.976879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:01.977892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:01.978139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:01.978611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:01.990158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:01.991985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:02.004216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1044/2110] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:03.429920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:03.431602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:03.504612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6e56-3298-40f4-b8a3-ecfd7d0be385 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:03.510653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:03.512091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:03.512307 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:03.512785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:03.516062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:03.598604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:03.600359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20896177-0345-47bb-b8ea-ea861c353a32 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:03.612314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1067/2111] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:03.920309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:03.923113 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:04.062612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6107c47-64fe-4995-a46b-13e477c04cd0 service glance] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.068555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.070731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.071468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.072616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] PATH_INFO: `/v3/users/1a06bf5aa84f4878ba348c260c92dcf9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.074682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a06bf5aa84f4878ba348c260c92dcf9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.078682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.141137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:04.143077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a06bf5aa84f4878ba348c260c92dcf9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.152741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a06bf5aa84f4878ba348c260c92dcf9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.163218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a06bf5aa84f4878ba348c260c92dcf9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.163862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a06bf5aa84f4878ba348c260c92dcf9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.164488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a06bf5aa84f4878ba348c260c92dcf9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.190097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1045/2112] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:03 2022] DELETE /identity/v3/users/1a06bf5aa84f4878ba348c260c92dcf9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:04.195267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.195675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.196015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.218256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:04.219799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:04.298287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1068/2113] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:04.310506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.312391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:04.392542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d646-efcd-48f9-8058-49b71a3ccdaa admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.397367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.398203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.398544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.398810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.410958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.412494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.423798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1046/2114] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:05.009531 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:05.011266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:05.024628 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33eabe-7da7-46a7-bd8f-f304073edace None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:05.030104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:05.030969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:05.031269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:05.031676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] PATH_INFO: `/v3/projects/ff925b8949d94c65aa0e8e4a61b4da20` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:05.033015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff925b8949d94c65aa0e8e4a61b4da20)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:05.035473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:05.066833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:05.102811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff925b8949d94c65aa0e8e4a61b4da20', 'request_id': 'req-4da35f92-8683-4439-8b35-911728dff4ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.114178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff925b8949d94c65aa0e8e4a61b4da20', 'request_id': 'req-4da35f92-8683-4439-8b35-911728dff4ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.126872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff925b8949d94c65aa0e8e4a61b4da20', 'request_id': 'req-4da35f92-8683-4439-8b35-911728dff4ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.143431 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] The token cache is being invalidate because project ff925b8949d94c65aa0e8e4a61b4da20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:05.143722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.144393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.146306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1069/2115] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:05 2022] DELETE /identity/v3/projects/ff925b8949d94c65aa0e8e4a61b4da20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:05.151290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:05.163979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0edfb-351d-4aac-bfc2-222451d82028 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:05.259341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:05.262646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:05.263498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:05.264192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] PATH_INFO: `/v3/users/2911ce76265c45ab98993a8ef191ca18` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:05.268244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2911ce76265c45ab98993a8ef191ca18)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:05.272210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:05.357270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2911ce76265c45ab98993a8ef191ca18'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.369989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2911ce76265c45ab98993a8ef191ca18'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.383904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2911ce76265c45ab98993a8ef191ca18'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.384627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2911ce76265c45ab98993a8ef191ca18'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.385486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2911ce76265c45ab98993a8ef191ca18'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:05.392659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:05.419981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1047/2116] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:05 2022] DELETE /identity/v3/users/2911ce76265c45ab98993a8ef191ca18 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:05.837338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:05.842395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:05.892948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35f92-8683-4439-8b35-911728dff4ca admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:05.987488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:05.988780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:05.988780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:05.989236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] PATH_INFO: `/v3/projects/f58751e3ef804214b9fedacafa7cf76b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:05.990722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58751e3ef804214b9fedacafa7cf76b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:05.993099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:06.061074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58751e3ef804214b9fedacafa7cf76b', 'request_id': 'req-3450ca69-c3b1-4e9e-adf8-5d457be29535'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.069911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58751e3ef804214b9fedacafa7cf76b', 'request_id': 'req-3450ca69-c3b1-4e9e-adf8-5d457be29535'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.076892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58751e3ef804214b9fedacafa7cf76b', 'request_id': 'req-3450ca69-c3b1-4e9e-adf8-5d457be29535'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.088727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] The token cache is being invalidate because project f58751e3ef804214b9fedacafa7cf76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:06.089021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.089682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.091273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1070/2117] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:05 2022] DELETE /identity/v3/projects/f58751e3ef804214b9fedacafa7cf76b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:06.095688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:06.097133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:06.110686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0941-bdd8-4c0e-a891-652850c6c93d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:06.187924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:06.188833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:06.189111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:06.189379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] PATH_INFO: `/v3/users/b469e5231d6b4e6a9289a10498d74fb4` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:06.190622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b469e5231d6b4e6a9289a10498d74fb4)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:06.192648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:06.264394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b469e5231d6b4e6a9289a10498d74fb4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.274623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b469e5231d6b4e6a9289a10498d74fb4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.286330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b469e5231d6b4e6a9289a10498d74fb4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.287449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b469e5231d6b4e6a9289a10498d74fb4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.288296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6de8b413-ffb0-4779-bdd5-2dadf4cbaa66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b469e5231d6b4e6a9289a10498d74fb4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:06.310635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1048/2118] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:06 2022] DELETE /identity/v3/users/b469e5231d6b4e6a9289a10498d74fb4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:06.815201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:06.821589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:06.878267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450ca69-c3b1-4e9e-adf8-5d457be29535 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:06.943736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:06.975682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:06.977069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:06.977069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:06.977312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] PATH_INFO: `/v3/projects/b0ccd80e45b94458844ea2ba161940ab` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:06.978692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ccd80e45b94458844ea2ba161940ab)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:06.980682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.038018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ccd80e45b94458844ea2ba161940ab', 'request_id': 'req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:07.048504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ccd80e45b94458844ea2ba161940ab', 'request_id': 'req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:07.055573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ccd80e45b94458844ea2ba161940ab', 'request_id': 'req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:07.067144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] The token cache is being invalidate because project b0ccd80e45b94458844ea2ba161940ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:07.067926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:07.068210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccd940c4-a81e-4a20-b6be-8db2d2507f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:07.070401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1071/2119] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:06 2022] DELETE /identity/v3/projects/b0ccd80e45b94458844ea2ba161940ab => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:07.076277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.076571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.076846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.110945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:07.113431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:07.219610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1049/2120] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:07.225853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.226126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.226406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.277885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:07.289034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:07.334832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.335532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1072/2121] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:07.343219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:07.349547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc622-e5ef-4f29-94b2-fd61503d3224 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.360426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.361120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.361414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.363889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.364653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:07.364956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.366868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.412210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1050/2122] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:26:07.417393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.431697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4956d-cd39-4230-845b-788b877bdaaa None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.438964 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.439997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.440427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.440873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.441744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.446368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.507123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1073/2123] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:07 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:07.515221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.573088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6efff-a4b1-404a-ac83-751a20f232ab admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.718277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.719349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.719789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.720077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.721445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.723807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.753125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1051/2124] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:07 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:07.757442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.770040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ab81a-4e2c-4ccd-b069-308033c349f1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.775041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.776364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.776364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.776364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.777067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.779781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.793547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1074/2125] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:07.798141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.812309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17e2-df77-4a89-9e3c-2fe22e0f5485 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.817292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.818149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.818444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.818822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.819592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.821194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55655f-93c5-42a7-98cd-6188e52e9e78 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.836572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1052/2126] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:07.840106 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:07.863060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75619-252f-44ce-9385-870117ad3a39 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:07.868864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:07.869839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.870206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.870543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] PATH_INFO: `/v3/projects/f23297810aca46b592c285e8ab8f7112/users/a39171134f1143fc9a3046b543385582/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.889373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23297810aca46b592c285e8ab8f7112, user_id=a39171134f1143fc9a3046b543385582, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:07.892220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:07.910671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1075/2127] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:07 2022] PUT /identity/v3/projects/f23297810aca46b592c285e8ab8f7112/users/a39171134f1143fc9a3046b543385582/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:07.921504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:07.921813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:07.922131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:07.954735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] MFA Rules not processed for user `a39171134f1143fc9a3046b543385582`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:07.956175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:08.046710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1053/2128] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:08.054308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:08.056501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:08.124123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea09-c736-476e-9617-ab5fca3a2588 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:08.128601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:08.130860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:08.130860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:08.130860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:08.142319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:08.143874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b42699-e344-473a-bf67-bb27679d9807 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:08.166228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1076/2129] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:08.882610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:08.884317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:08.986163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e862b7-0da7-4a0e-aeb8-38c251701115 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:08.992106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:08.993894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:08.994554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:08.995642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] PATH_INFO: `/v3/users/8e0c51aa56114ba6ae8fafd9c57c5f93` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:08.997120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0c51aa56114ba6ae8fafd9c57c5f93)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:08.999468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:09.001871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.062213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176aa9a-6693-4bbb-b08a-b61ab418a740 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.062889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176aa9a-6693-4bbb-b08a-b61ab418a740 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.063512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176aa9a-6693-4bbb-b08a-b61ab418a740 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.068823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1077/2130] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:26:09.086560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c968a-fce6-4cc7-9c7d-9957687dd191 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.086846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c968a-fce6-4cc7-9c7d-9957687dd191 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.087207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c968a-fce6-4cc7-9c7d-9957687dd191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.103881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0c51aa56114ba6ae8fafd9c57c5f93'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.104482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.118843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a41c968a-fce6-4cc7-9c7d-9957687dd191 None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:09.125997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0c51aa56114ba6ae8fafd9c57c5f93'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.126864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a41c968a-fce6-4cc7-9c7d-9957687dd191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.152406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0c51aa56114ba6ae8fafd9c57c5f93'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.153068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0c51aa56114ba6ae8fafd9c57c5f93'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.153972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0c51aa56114ba6ae8fafd9c57c5f93'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.184544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1054/2131] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:08 2022] DELETE /identity/v3/users/8e0c51aa56114ba6ae8fafd9c57c5f93 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:09.188445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:09.190327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.227019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1078/2132] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:09.228648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.228937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.229205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.251081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:09.252395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.291797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f51b-ce9b-4cf0-b7a4-06ae3fbc627d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:09.301042 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:09.302535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.303049 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.303586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] PATH_INFO: `/v3/users/5fe7bb321ebf4bcb900cc5d6b7ee5517` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.305898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe7bb321ebf4bcb900cc5d6b7ee5517)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:09.309654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:09.321263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1079/2133] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:09.322219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:09.323520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.379152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe7bb321ebf4bcb900cc5d6b7ee5517'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.387739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe7bb321ebf4bcb900cc5d6b7ee5517'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.396922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe7bb321ebf4bcb900cc5d6b7ee5517'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.397552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe7bb321ebf4bcb900cc5d6b7ee5517'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.398162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe7bb321ebf4bcb900cc5d6b7ee5517'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.407982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d690788-9306-47fe-94d3-c2559d0db943 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:09.413337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.413948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:09.414642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.414903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.415191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.417184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.419967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1055/2134] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:09 2022] DELETE /identity/v3/users/5fe7bb321ebf4bcb900cc5d6b7ee5517 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:09.422788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:09.424554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.432622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:09.434296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:09.447709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1080/2135] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:09.505892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f1776-9e90-4b0b-bcf0-0953025b532f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:09.510263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:09.510818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.511141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.511741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.513837 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.593983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:09.595541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae2875-1d90-4205-ae30-ca6a3606c80b service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:09.605979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1056/2136] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:09.633937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:09.635444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.658600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7f291-1126-432f-8121-1fb3d6a0dba9 service placement] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:09.666586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:09.667660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.667858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.668127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] PATH_INFO: `/v3/projects/8d4f43aa44654db490506bd6255f893b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.669512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4f43aa44654db490506bd6255f893b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:09.672040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:09.732135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.760388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4f43aa44654db490506bd6255f893b', 'request_id': 'req-ffcf555c-d2ae-472a-a60e-4cba931ed994'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.770058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4f43aa44654db490506bd6255f893b', 'request_id': 'req-ffcf555c-d2ae-472a-a60e-4cba931ed994'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.781482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4f43aa44654db490506bd6255f893b', 'request_id': 'req-ffcf555c-d2ae-472a-a60e-4cba931ed994'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.796951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] The token cache is being invalidate because project 8d4f43aa44654db490506bd6255f893b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:09.797390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.798128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ffcf555c-d2ae-472a-a60e-4cba931ed994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:09.800185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1081/2137] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:09 2022] DELETE /identity/v3/projects/8d4f43aa44654db490506bd6255f893b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:09.808269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.808269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.808269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:09.847421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:09.848423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:09.956739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1057/2138] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:09.970037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:09.970324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:09.970630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.005186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.006724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:10.008684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.014125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.031003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1082/2139] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:10.036361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.050525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff557fa7-b3ef-4736-92c0-bf74ec6564a1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.050958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbda557-1af1-488c-bbe3-f39479d48348 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.061992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.062646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.063271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.063540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.063737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.063834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.064119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] PATH_INFO: `/v3/projects/a57e9bb98bbf4d36bcf16ef6f33a8a59` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.064228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.065159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:10.065524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.066085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57e9bb98bbf4d36bcf16ef6f33a8a59)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.068322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.068686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.083163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1083/2140] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:10.090750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.116543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190cb4-656c-4010-9f79-3be58198a01d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.127950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.134518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57e9bb98bbf4d36bcf16ef6f33a8a59', 'request_id': 'req-66559b0e-0f2e-4e87-9a37-182615eb4c0e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.151772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57e9bb98bbf4d36bcf16ef6f33a8a59', 'request_id': 'req-66559b0e-0f2e-4e87-9a37-182615eb4c0e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.165451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57e9bb98bbf4d36bcf16ef6f33a8a59', 'request_id': 'req-66559b0e-0f2e-4e87-9a37-182615eb4c0e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.181784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] The token cache is being invalidate because project a57e9bb98bbf4d36bcf16ef6f33a8a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:10.182035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.182820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.187257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1058/2141] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:10 2022] DELETE /identity/v3/projects/a57e9bb98bbf4d36bcf16ef6f33a8a59 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:10.191946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.192745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.193587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.193766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.194046 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.194591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.196229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.197644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.211534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559b0e-0f2e-4e87-9a37-182615eb4c0e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.221760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.221760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.221760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.221760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] PATH_INFO: `/v3/users/9143589cd48e489e8771f1a198d63d2d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.222278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9143589cd48e489e8771f1a198d63d2d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.223678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.241393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1084/2142] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:10.254511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.256518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.288679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9143589cd48e489e8771f1a198d63d2d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.299514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9143589cd48e489e8771f1a198d63d2d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.309266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9143589cd48e489e8771f1a198d63d2d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.310325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9143589cd48e489e8771f1a198d63d2d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.311512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9143589cd48e489e8771f1a198d63d2d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.336479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20600a79-fc77-40f3-bb24-bb0a182cced1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.338852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1059/2143] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:10 2022] DELETE /identity/v3/users/9143589cd48e489e8771f1a198d63d2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:10.371590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.424879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.425637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.426020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.426294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.428249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.431357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.462577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1085/2144] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:10.466530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.470146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.484043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5b96-ca6d-4449-bbbf-97c9e6eb7652 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.489207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.489894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.490169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.490439 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.491167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.492926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.505619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1060/2145] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:10.510019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.521312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a513-4b13-48a0-ac2d-36699fff16bd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.527238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.528150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.528565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.528885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.529868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.531754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40088b0-b5a5-4afa-8409-e6fa1e2a2c15 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.551558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.552982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1086/2146] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:10.563174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39fa-6019-4623-adc5-38c0560302bc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.568133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.569114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.569395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.569667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] PATH_INFO: `/v3/projects/7ec0b458db8e40c7aa308a882949c77a/users/ef28fef252ed4dcfb7815b4150a18cbe/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.586004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec0b458db8e40c7aa308a882949c77a, user_id=ef28fef252ed4dcfb7815b4150a18cbe, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.588743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.603920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1061/2147] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:10 2022] PUT /identity/v3/projects/7ec0b458db8e40c7aa308a882949c77a/users/ef28fef252ed4dcfb7815b4150a18cbe/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:10.609349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.609713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.609998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.629256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:10.630407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.676979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.679468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.708030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1087/2148] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:10.717848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.719588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.760066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a51ac-bcbd-44cc-98ac-e363482d1f79 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.765701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.766670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.766967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.767237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] PATH_INFO: `/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.768511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3733e1c16f0e4e4c8605c2efa9f03299)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.770964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.782475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f7613-9fcb-4b32-9959-a17f3f7cfee8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.782689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.787155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.788088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.788501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.788906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.801093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.802575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb100-39ed-4740-9688-d25f38bd3ef8 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.813583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1088/2149] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:26:10.823281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3733e1c16f0e4e4c8605c2efa9f03299', 'request_id': 'req-32234059-f385-4ac0-afb8-0d9b748f336d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.831650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3733e1c16f0e4e4c8605c2efa9f03299', 'request_id': 'req-32234059-f385-4ac0-afb8-0d9b748f336d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.840596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3733e1c16f0e4e4c8605c2efa9f03299', 'request_id': 'req-32234059-f385-4ac0-afb8-0d9b748f336d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.854101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] The token cache is being invalidate because project 3733e1c16f0e4e4c8605c2efa9f03299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:10.854475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.855358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32234059-f385-4ac0-afb8-0d9b748f336d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:10.857228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1062/2150] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:10 2022] DELETE /identity/v3/projects/3733e1c16f0e4e4c8605c2efa9f03299 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:10.863345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.863756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.864042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.888143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:10.888899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.953607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.983381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1089/2151] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:10.992449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.993027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.993027 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.027592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:11.029145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:11.043349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1063/2152] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:11.051005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.070529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40cd66-b3ad-4de8-9f56-d70a2fcc6f3b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.079516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.080464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.080978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.081467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.093186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:11.093186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.097944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.131120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1090/2153] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:11.135859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.146660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece6df3-1c3c-4b05-bc6f-6d466e6f364b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.154609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.155862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.156257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.156700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.157571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.160454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.207348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1064/2154] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:11 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:11.209535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.223814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb42c9-bdf6-4b0d-b7b1-209bb2a776c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.360118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.360118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.361428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.361524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.362633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.366827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.394963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1091/2155] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:11 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:11.396213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.408201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813ab30-01d4-4743-b17f-3fc28dca6719 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.413232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.413914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.414192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.414460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.415196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.416867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.432984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1065/2156] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:11.437095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.451547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54c90-c9c3-4c6d-a19b-be82ba0aea22 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.461582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.462363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.462795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.463077 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.463917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.465615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591e904-6bde-40a3-913c-b8c0cc08c260 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.478546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1092/2157] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:11.482919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.505364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee9e53-a071-4873-9580-e0bb3bba3d72 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.510996 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.512157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.512434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.512735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] PATH_INFO: `/v3/projects/982aec69ffce4ea2bb98d5c60039efbc/users/4ddd8e3dce3c4b6580b022190368ae6d/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.537033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=982aec69ffce4ea2bb98d5c60039efbc, user_id=4ddd8e3dce3c4b6580b022190368ae6d, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.539959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.557187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1066/2158] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:11 2022] PUT /identity/v3/projects/982aec69ffce4ea2bb98d5c60039efbc/users/4ddd8e3dce3c4b6580b022190368ae6d/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:11.570196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.570488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.570753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.606405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] MFA Rules not processed for user `4ddd8e3dce3c4b6580b022190368ae6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:11.608055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:11.732224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1093/2159] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:11.747531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:11.749976 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:11.829961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e7f5-8862-482a-ae7b-63e02b3bdc8b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:11.836550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:11.837230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:11.837818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:11.837818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:11.849674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:11.851181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037553-1959-4f8a-a769-c38e4fe7ef0b service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:11.863746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1067/2160] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:14.376310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:14.380340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:14.480645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:14.521642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c1be4-14a1-4e3c-bdfa-47d6b953cc59 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:14.557736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:14.559350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:14.559825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:14.560295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] PATH_INFO: `/v3/users/81efa8a82f2d4edaae7c84346b13aa49` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:14.564162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=81efa8a82f2d4edaae7c84346b13aa49)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:14.569852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:14.679671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81efa8a82f2d4edaae7c84346b13aa49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:14.692626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81efa8a82f2d4edaae7c84346b13aa49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:14.723943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81efa8a82f2d4edaae7c84346b13aa49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:14.726745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81efa8a82f2d4edaae7c84346b13aa49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:14.746449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81efa8a82f2d4edaae7c84346b13aa49'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:14.760809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1094/2161] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:14 2022] DELETE /identity/v3/users/81efa8a82f2d4edaae7c84346b13aa49 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:14.775006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:14.775621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:14.775723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:14.814470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:14.814791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:14.897559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:15.001381 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1068/2162] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:15.034114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:15.035918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:15.193590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5b4b-7a03-489e-8809-d9e4050a37ac admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:15.198113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:15.198808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:15.199294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:15.199975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:15.213770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:15.215532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c1a9-ced5-4e39-864f-9f9f5ff04a22 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:15.235518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1095/2163] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:15.892440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:15.895714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:15.932182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380be57-4503-4b61-9b79-688e76fa38f4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:15.942065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:15.943525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:15.943870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:15.944218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] PATH_INFO: `/v3/projects/7cc89545a373489a9316846fb571b920` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:15.945698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc89545a373489a9316846fb571b920)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:15.948401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.024981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc89545a373489a9316846fb571b920', 'request_id': 'req-e2ad4b85-5339-4e1c-90e4-63a3cf689132'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:16.031916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc89545a373489a9316846fb571b920', 'request_id': 'req-e2ad4b85-5339-4e1c-90e4-63a3cf689132'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:16.045322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc89545a373489a9316846fb571b920', 'request_id': 'req-e2ad4b85-5339-4e1c-90e4-63a3cf689132'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:16.073557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] The token cache is being invalidate because project 7cc89545a373489a9316846fb571b920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:16.074141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:16.075090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e2ad4b85-5339-4e1c-90e4-63a3cf689132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:16.077409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1069/2164] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:15 2022] DELETE /identity/v3/projects/7cc89545a373489a9316846fb571b920 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:16.083581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.084110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.084762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.117026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:16.119255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:16.249165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1096/2165] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:16.258360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.258360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.258720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.282880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:16.285459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:16.300418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1070/2166] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:16.303736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.316096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145db8d9-77ed-4459-a144-71c7dc7cfa68 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.321390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.322496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.322904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.323186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.323985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:16.324296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.325979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.329967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:16.351498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1097/2167] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:26:16.356236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.374663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e5d4b-277b-4e3d-a201-23917f38ae89 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.383037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.384044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.384479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.385520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.386490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.389486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36db6-01dd-4e6d-b0be-97dfd7c928ae admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.479874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1071/2168] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:16.483527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.501232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533e9e4-1f23-49d5-b897-1fb405b3d92e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.654703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.659645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.660047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.660379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.661162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.663196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.677152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.677662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.678040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.750360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1098/2169] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:16 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:16.751692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.762089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] MFA Rules not processed for user `ef28fef252ed4dcfb7815b4150a18cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:16.766069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:16.784520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b64552-3b98-40d6-851a-45daee682dc3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.794759 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.795813 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.796120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.803023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.803999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.805683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.825045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1099/2170] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:16.826332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.837552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25cf49-f3e1-4c97-8abe-848c9b47cc64 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.843140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.843951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.844247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.844523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.845335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.847004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:16.863542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1100/2171] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:16.866880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.881988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927ef4-c806-46cd-a1f0-e5a99f423b23 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:16.884298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1072/2172] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:16.909676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:16.913867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:16.917290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:16.919341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:16.920070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:16.920760 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] PATH_INFO: `/v3/projects/1c8981065cfa44f784055d37a8d0fc55/users/be013adb049245c0bc7b3c288968e6b5/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:16.995218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8981065cfa44f784055d37a8d0fc55, user_id=be013adb049245c0bc7b3c288968e6b5, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:16.998056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b4e6-83e4-42cd-a79d-235c50b19cc1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:17.003628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:17.040742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1101/2173] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:16 2022] PUT /identity/v3/projects/1c8981065cfa44f784055d37a8d0fc55/users/be013adb049245c0bc7b3c288968e6b5/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:17.055021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:17.059786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:17.069551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:17.106615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69800c-881f-4f39-9f7b-b2948539b3bf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:17.111100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] MFA Rules not processed for user `be013adb049245c0bc7b3c288968e6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:17.112688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:17.213515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1102/2174] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:17.222968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:17.224139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:17.224527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:17.224870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:17.235798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:17.235798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:17.304951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:17.347715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:17.349751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4e25-02e3-4d47-b20b-14308e639a51 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:17.361033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63a421-d6e3-4fe0-8bf5-315e83694078 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:17.368089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:17.369293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:17.369987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:17.370489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:17.375540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1073/2175] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:17.382781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:17.384965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:17.400454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1103/2176] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:19.385466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adb0ac-cbd0-4756-8524-486c562f61c4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:19.385960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adb0ac-cbd0-4756-8524-486c562f61c4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:19.386063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adb0ac-cbd0-4756-8524-486c562f61c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:19.404696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-33adb0ac-cbd0-4756-8524-486c562f61c4 None None] MFA Rules not processed for user `ef28fef252ed4dcfb7815b4150a18cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:19.406038 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-33adb0ac-cbd0-4756-8524-486c562f61c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:19.415396 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1074/2177] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:19.968533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:19.970685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.104121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3d2c7-444b-496c-abed-074cde24e064 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.112556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.113514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.113786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.114058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] PATH_INFO: `/v3/users/a39171134f1143fc9a3046b543385582` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.117830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39171134f1143fc9a3046b543385582)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.121285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:20.217874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39171134f1143fc9a3046b543385582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.257905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39171134f1143fc9a3046b543385582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.275512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39171134f1143fc9a3046b543385582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.276820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39171134f1143fc9a3046b543385582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.294852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39171134f1143fc9a3046b543385582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.306367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1104/2178] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:19 2022] DELETE /identity/v3/users/a39171134f1143fc9a3046b543385582 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:20.308072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.308292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.308572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.350479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:20.351781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.407249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:20.429757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1075/2179] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:20.440225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.441722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.547364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83134-27ed-44ee-8b7c-990dcacfb361 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.551610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.552376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.552568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.552847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.566975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:20.573189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.575720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:20.598514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1105/2180] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:20.949653 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.951394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.968813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46a3b-82e7-4954-9f34-64d6e14f3b2f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.975994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.982177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.982504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.982946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] PATH_INFO: `/v3/projects/f23297810aca46b592c285e8ab8f7112` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.985405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23297810aca46b592c285e8ab8f7112)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.987575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.088209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23297810aca46b592c285e8ab8f7112', 'request_id': 'req-1db40262-d495-4e9f-bd84-0bba0906b861'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.099527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23297810aca46b592c285e8ab8f7112', 'request_id': 'req-1db40262-d495-4e9f-bd84-0bba0906b861'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.111937 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23297810aca46b592c285e8ab8f7112', 'request_id': 'req-1db40262-d495-4e9f-bd84-0bba0906b861'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.126465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] The token cache is being invalidate because project f23297810aca46b592c285e8ab8f7112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:21.126676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.127397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1db40262-d495-4e9f-bd84-0bba0906b861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.129397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1076/2181] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:20 2022] DELETE /identity/v3/projects/f23297810aca46b592c285e8ab8f7112 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:21.181304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.183707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:21.199565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd2d38-ff08-4b7a-9f44-f0cad7685075 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.287739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.288664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.288946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.289225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] PATH_INFO: `/v3/users/be013adb049245c0bc7b3c288968e6b5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.292379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be013adb049245c0bc7b3c288968e6b5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.296875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.381503 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be013adb049245c0bc7b3c288968e6b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.402164 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be013adb049245c0bc7b3c288968e6b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.436198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be013adb049245c0bc7b3c288968e6b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.440337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be013adb049245c0bc7b3c288968e6b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.455158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be013adb049245c0bc7b3c288968e6b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:21.464590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1106/2182] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:21 2022] DELETE /identity/v3/users/be013adb049245c0bc7b3c288968e6b5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:21.468614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.469139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.469243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.490769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:21.491988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:21.570965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1077/2183] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:21.580693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.583389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:21.680098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4026e-5670-4e6c-a277-31fb169056e8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.684263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.685044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.685316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.685856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.707627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.710200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd076-ec45-43a9-a4e2-d1b2a72b031f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.728785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1107/2184] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:22.094830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.105059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.122730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbccead-ee15-41fd-993d-329a0933b8fe None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.128641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.129547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.129826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.130094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] PATH_INFO: `/v3/projects/1c8981065cfa44f784055d37a8d0fc55` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.131742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8981065cfa44f784055d37a8d0fc55)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.133752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.195836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8981065cfa44f784055d37a8d0fc55', 'request_id': 'req-022381b9-1b14-4774-8ab7-0ce0203de97f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:22.202688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8981065cfa44f784055d37a8d0fc55', 'request_id': 'req-022381b9-1b14-4774-8ab7-0ce0203de97f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:22.211857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8981065cfa44f784055d37a8d0fc55', 'request_id': 'req-022381b9-1b14-4774-8ab7-0ce0203de97f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:22.220929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:22.226496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] The token cache is being invalidate because project 1c8981065cfa44f784055d37a8d0fc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:22.226773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:22.227876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-022381b9-1b14-4774-8ab7-0ce0203de97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:22.229785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1078/2185] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:22 2022] DELETE /identity/v3/projects/1c8981065cfa44f784055d37a8d0fc55 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:22.235889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.236707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.236889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.265000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:22.267196 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.279867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:22.350845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1108/2186] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:22.359275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.359735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.360115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.389753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:22.391451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.401788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1079/2187] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:22.406772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.425545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce18bb-90df-474a-8156-542aa1196716 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.431794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.432534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.432824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.433102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.433866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:22.434149 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.435884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.449693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1109/2188] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:22.454550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.466854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5ccf-258b-4c24-8ec0-08c0086aff99 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.473633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.474324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.474607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.474878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.475640 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.477601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.534284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1080/2189] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:22.537966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.551916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700fed0-e831-42df-be30-dff9475ee6f8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.616373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.617067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.617357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.617658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.618581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.620674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.642543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1110/2190] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:22.646878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.659075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdf6a-f227-48b6-be59-1744ae246ab6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.664026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.664735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.665036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.665290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.666036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.667704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.680220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1081/2191] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:22.684176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.696145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d17434-9e07-4fe6-aa71-0c7418ff5abc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.701702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.702494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.702771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.703201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.704260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.706391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e374be7-932a-4f65-807f-970b29c17926 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.720160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1111/2192] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:22.724698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.736455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c59f-9c5e-4587-a04a-835b2ed80931 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.742011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.742929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.743203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.743504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] PATH_INFO: `/v3/projects/fa9727eba1e54e0aba3ba2a4fe123186/users/99c72bb569b74f3c9d5087919ea10b4a/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.761817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9727eba1e54e0aba3ba2a4fe123186, user_id=99c72bb569b74f3c9d5087919ea10b4a, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.764554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.786430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1082/2193] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:22 2022] PUT /identity/v3/projects/fa9727eba1e54e0aba3ba2a4fe123186/users/99c72bb569b74f3c9d5087919ea10b4a/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:22.797817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.798094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.798375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.841235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] MFA Rules not processed for user `99c72bb569b74f3c9d5087919ea10b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:22.842584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.948037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1112/2194] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:22.952868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.032416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001153-c034-4c2e-9e6a-e64976896026 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.038175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.038868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.039151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.039459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.040177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.042273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.072710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1083/2195] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:23.078498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.092734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2c43f-29cb-40ae-aa75-95f4abb0794a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.110937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:23.169833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.170550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.170830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.171105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.171890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.173915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.204070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1113/2196] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:23 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:23.205342 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.217242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3289-baed-4b2f-b827-b0993d32da19 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.222646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.223360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.223647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.223923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.224670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.226293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.238488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1084/2197] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:23.242858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.254169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1cda0-f520-48d5-ad85-a41d307caae0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.259470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.260174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.260460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.260733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.261473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.263127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402afd2-92d0-4a8c-aaa6-51eb1b2b889a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.274420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1114/2198] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:23.278920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.290043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10766-bdb7-4a1e-afe6-5a96670ad1a1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.294935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.295888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.296168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.296459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] PATH_INFO: `/v3/projects/355d20f9464444e0908048b9f3f0bcc3/users/53f368f22c3145c38d0c6c1ff9a31ebc/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.312833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355d20f9464444e0908048b9f3f0bcc3, user_id=53f368f22c3145c38d0c6c1ff9a31ebc, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.315556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.337141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1085/2199] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:23 2022] PUT /identity/v3/projects/355d20f9464444e0908048b9f3f0bcc3/users/53f368f22c3145c38d0c6c1ff9a31ebc/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:23.415461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.415771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.415992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.446674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] MFA Rules not processed for user `53f368f22c3145c38d0c6c1ff9a31ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:23.447966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:23.523561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1115/2200] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:23.528714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.602892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:23.638463 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa243-8ebb-4c1d-8e4b-ebb1e7055b32 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.643892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.644568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.644845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.645115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.645830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.647846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.679083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1086/2201] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:23 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:23.683830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.702326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1fd61-ace3-48a0-ba40-7dbb819e2e2e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.794041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.795219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.795842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.796753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.798163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.802446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.825039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1116/2202] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:23 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:23.829589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.841190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410772-1987-4846-a6bd-bda1b67fc9fc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.846388 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.847067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.847369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.847643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.848384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.850014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.861919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1087/2203] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:23.866697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.879180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8627-c658-4006-a10a-730070b987d2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:23.887127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:23.889746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.890114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.890752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] PATH_INFO: `/v3/projects/9f084f2ce671487f9d5342083916a81e/users/11040c571d2044fb98b9290b2cbfc763/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.899447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:23.916749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f084f2ce671487f9d5342083916a81e, user_id=11040c571d2044fb98b9290b2cbfc763, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:23.919579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:23.935836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1117/2204] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:23 2022] PUT /identity/v3/projects/9f084f2ce671487f9d5342083916a81e/users/11040c571d2044fb98b9290b2cbfc763/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:23.940884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:23.952939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861a88-1200-4761-b92e-861eee7ff9ab admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:24.025824 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:24.026503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.026785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.027067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.027849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:24.029541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e09d7-cd63-4e16-8fe7-22b5d3244091 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:24.042689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1088/2205] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:24.047433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:24.061501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce66d1-336d-44b0-9b32-6c2e0416d144 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:24.066991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:24.068002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.068288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.068570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] PATH_INFO: `/v3/projects/9f084f2ce671487f9d5342083916a81e/users/11040c571d2044fb98b9290b2cbfc763/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.070838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f084f2ce671487f9d5342083916a81e, user_id=11040c571d2044fb98b9290b2cbfc763, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:24.073621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:24.087704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1118/2206] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:24 2022] PUT /identity/v3/projects/9f084f2ce671487f9d5342083916a81e/users/11040c571d2044fb98b9290b2cbfc763/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:24.098591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205083-7d06-41a0-ba6d-d7789848e870 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.098895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205083-7d06-41a0-ba6d-d7789848e870 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.099169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205083-7d06-41a0-ba6d-d7789848e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.139347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-dc205083-7d06-41a0-ba6d-d7789848e870 None None] MFA Rules not processed for user `11040c571d2044fb98b9290b2cbfc763`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:24.140928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dc205083-7d06-41a0-ba6d-d7789848e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:24.223722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1089/2207] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:24.236297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:24.238156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:24.326102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984f8ff-b00d-48db-9c32-479a50a8163c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:24.330191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:24.330876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.331166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.331481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.395206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:24.396746 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7912-93a4-408c-9a80-3695b4a258b2 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:24.414586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1119/2208] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:24.922541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.923158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.923158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.924722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1090/2209] 10.222.0.82 () {54 vars in 912 bytes} [Wed Jul 20 19:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:24.931506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.931792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.932072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.952754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:24.954329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:25.014901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1120/2210] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:25.029166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:25.031225 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:25.045913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b290eb-149b-4b25-ba35-2d54474d621c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:25.050194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:25.050875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:25.051154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:25.051462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:25.060651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:25.062875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:25.073102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1091/2211] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:26.128626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:26.130371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:26.144011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3832722-3a8a-4e36-92f5-2cf3853de1db None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:26.149579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:26.150871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:26.151452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:26.152058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:26.209100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:26.245324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:26.246825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:26.257460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1121/2212] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:26.984926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:26.995574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5e49-576b-4d53-9eee-4d6a117baccf service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:27.000412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:27.001493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:27.001845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:27.002340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:27.014020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:27.015499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674e6d-eb4b-48a6-9a2f-e2ab0c73285f service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:27.027389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1092/2213] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:31.598857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:31.693313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbf8db-6653-4709-942a-a5df384201ca service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:31.698592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:31.699818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:31.700289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:31.700441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] PATH_INFO: `/v3/users/99c72bb569b74f3c9d5087919ea10b4a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:31.702214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c72bb569b74f3c9d5087919ea10b4a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:31.704449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:31.757654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c72bb569b74f3c9d5087919ea10b4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:31.768579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c72bb569b74f3c9d5087919ea10b4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:31.785245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c72bb569b74f3c9d5087919ea10b4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:31.786037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c72bb569b74f3c9d5087919ea10b4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:31.795869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c72bb569b74f3c9d5087919ea10b4a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:31.802511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1122/2214] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:31 2022] DELETE /identity/v3/users/99c72bb569b74f3c9d5087919ea10b4a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:31.807429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:31.807969 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:31.808067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:31.827346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:31.828868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:31.838632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:31.901945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1093/2215] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:31.915535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:31.917251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:31.981684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b43632-c303-403b-9cb1-b4db73b3d48b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:31.985386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:31.986054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:31.986338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:31.986616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:31.994179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:31.996673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:31.998549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:32.011981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1123/2216] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:32.313574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:32.315440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:32.328754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bd7d4-a406-41f5-b6d4-b87bdf3a9883 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:32.333494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:32.334374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:32.334648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:32.334913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] PATH_INFO: `/v3/projects/fa9727eba1e54e0aba3ba2a4fe123186` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:32.336336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9727eba1e54e0aba3ba2a4fe123186)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:32.338295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:32.393667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9727eba1e54e0aba3ba2a4fe123186', 'request_id': 'req-686db099-3f34-4e9f-88ef-641760dddbff'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.402730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9727eba1e54e0aba3ba2a4fe123186', 'request_id': 'req-686db099-3f34-4e9f-88ef-641760dddbff'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.413070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9727eba1e54e0aba3ba2a4fe123186', 'request_id': 'req-686db099-3f34-4e9f-88ef-641760dddbff'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.425358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] The token cache is being invalidate because project fa9727eba1e54e0aba3ba2a4fe123186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:32.425645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.426437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.428077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1094/2217] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:32 2022] DELETE /identity/v3/projects/fa9727eba1e54e0aba3ba2a4fe123186 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:32.432197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:32.443513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a979-d0fd-44f6-b49e-ecf7eff638b5 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:32.501497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:32.502395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:32.502689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:32.502966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] PATH_INFO: `/v3/users/53f368f22c3145c38d0c6c1ff9a31ebc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:32.504210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f368f22c3145c38d0c6c1ff9a31ebc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:32.506250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:32.558646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f368f22c3145c38d0c6c1ff9a31ebc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.567718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f368f22c3145c38d0c6c1ff9a31ebc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.589364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f368f22c3145c38d0c6c1ff9a31ebc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.590339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f368f22c3145c38d0c6c1ff9a31ebc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.600693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f368f22c3145c38d0c6c1ff9a31ebc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:32.607919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1124/2218] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:32 2022] DELETE /identity/v3/users/53f368f22c3145c38d0c6c1ff9a31ebc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:32.951884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:32.956764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:32.976554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686db099-3f34-4e9f-88ef-641760dddbff admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:33.054183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:33.055360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:33.055650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:33.055927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] PATH_INFO: `/v3/projects/355d20f9464444e0908048b9f3f0bcc3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:33.057387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] RBAC: Authorizing `identity:delete_project(project_id=355d20f9464444e0908048b9f3f0bcc3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:33.059777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:33.132387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:33.157814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355d20f9464444e0908048b9f3f0bcc3', 'request_id': 'req-12fefeb3-137b-49b9-b995-3f231304189d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.165871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355d20f9464444e0908048b9f3f0bcc3', 'request_id': 'req-12fefeb3-137b-49b9-b995-3f231304189d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.175004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355d20f9464444e0908048b9f3f0bcc3', 'request_id': 'req-12fefeb3-137b-49b9-b995-3f231304189d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.187016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] The token cache is being invalidate because project 355d20f9464444e0908048b9f3f0bcc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:33.187419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.188090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.189652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1095/2219] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:32 2022] DELETE /identity/v3/projects/355d20f9464444e0908048b9f3f0bcc3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:33.193890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:33.195508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:33.209329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a181eb-9a57-43c6-abba-d1055473818c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:33.277497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:33.278385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:33.278680 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:33.278937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] PATH_INFO: `/v3/users/11040c571d2044fb98b9290b2cbfc763` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:33.280218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11040c571d2044fb98b9290b2cbfc763)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:33.282189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:33.299522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:33.335465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11040c571d2044fb98b9290b2cbfc763'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.344007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11040c571d2044fb98b9290b2cbfc763'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.356882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11040c571d2044fb98b9290b2cbfc763'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.357635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11040c571d2044fb98b9290b2cbfc763'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.365296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11040c571d2044fb98b9290b2cbfc763'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:33.372318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1125/2220] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:33 2022] DELETE /identity/v3/users/11040c571d2044fb98b9290b2cbfc763 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:33.872807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:33.874458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:33.901099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fefeb3-137b-49b9-b995-3f231304189d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:33.967665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:33.968576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:33.968855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:33.969143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] PATH_INFO: `/v3/projects/9f084f2ce671487f9d5342083916a81e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:33.970338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f084f2ce671487f9d5342083916a81e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:33.972311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:34.024544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f084f2ce671487f9d5342083916a81e', 'request_id': 'req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:34.031206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f084f2ce671487f9d5342083916a81e', 'request_id': 'req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:34.040712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f084f2ce671487f9d5342083916a81e', 'request_id': 'req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:34.052031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] The token cache is being invalidate because project 9f084f2ce671487f9d5342083916a81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:34.052320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:34.053024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a267b5fb-f072-4e6c-944b-a0d6f0eb11d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:34.054699 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1096/2221] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:33 2022] DELETE /identity/v3/projects/9f084f2ce671487f9d5342083916a81e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:38.803218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:38.804766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:38.819921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960db63-1692-465b-82ff-cb267eccab33 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:38.881439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:38.882338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:38.882622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:38.882893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] PATH_INFO: `/v3/users/4ddd8e3dce3c4b6580b022190368ae6d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:38.884290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddd8e3dce3c4b6580b022190368ae6d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:38.886308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:38.940050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddd8e3dce3c4b6580b022190368ae6d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:38.948206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddd8e3dce3c4b6580b022190368ae6d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:38.962530 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddd8e3dce3c4b6580b022190368ae6d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:38.963290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddd8e3dce3c4b6580b022190368ae6d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:38.970732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddd8e3dce3c4b6580b022190368ae6d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:38.976924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1126/2222] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:38 2022] DELETE /identity/v3/users/4ddd8e3dce3c4b6580b022190368ae6d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:38.981907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:38.982447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:38.982447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.000946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:39.002197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:39.065518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.077102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1097/2223] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:39.087792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.089384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:39.107793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.171584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be700c-d979-46fa-a9fe-a2a5b335d870 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:39.175924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:39.176583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.176864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.177139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.187127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:39.188676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718d282-fe49-4ff3-8419-007c0c8d0c49 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:39.198848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1127/2224] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:26:39.504115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.506341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:39.526471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb055-5cc5-40e4-9466-ab3d48d37bbd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:39.534954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:39.536769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.537430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.538104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] PATH_INFO: `/v3/projects/982aec69ffce4ea2bb98d5c60039efbc` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.539667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982aec69ffce4ea2bb98d5c60039efbc)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:39.541714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:39.598974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982aec69ffce4ea2bb98d5c60039efbc', 'request_id': 'req-0a687374-fda7-44e1-b1d3-0299f6172ae7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:39.606749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982aec69ffce4ea2bb98d5c60039efbc', 'request_id': 'req-0a687374-fda7-44e1-b1d3-0299f6172ae7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:39.616516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982aec69ffce4ea2bb98d5c60039efbc', 'request_id': 'req-0a687374-fda7-44e1-b1d3-0299f6172ae7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:39.629431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] The token cache is being invalidate because project 982aec69ffce4ea2bb98d5c60039efbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:39.629717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:39.630396 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a687374-fda7-44e1-b1d3-0299f6172ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:39.632205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1098/2225] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:39 2022] DELETE /identity/v3/projects/982aec69ffce4ea2bb98d5c60039efbc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:39.638004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.638297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.638676 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.664395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:39.665738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:39.733720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1128/2226] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:39.742442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.742741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.743018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.765145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:39.766654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:39.779637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1099/2227] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:39.784617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.795690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9267b3-dac5-47df-bb2e-856377b1fc32 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:39.801802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:39.802485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.802762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.803034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.803800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:39.804368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:39.805737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:39.820232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1129/2228] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:39.825753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.836160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b7bb7-1e3e-4b87-898d-5d2b1453c52c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:39.841625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:39.842360 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.842832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.843209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.844058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:39.846031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:39.880164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1100/2229] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:39 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:39.881386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.892023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301f04-315c-4856-8355-323949b0d2e0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:39.953646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:39.954545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:39.954818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:39.955094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:39.956123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:39.957872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:39.983159 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1130/2230] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:39 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:39.986588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:39.998221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559c0-171a-4e64-b160-4ef37b2e9f69 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.003584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.004319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.004611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.004883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.005626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.007288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.018829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1101/2231] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:40.023544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:40.035548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee471-8a1b-482c-a0ff-62b5b6ea4255 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.040415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.041094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.041376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.041653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.043069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.044802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002cf81-3d32-40b0-8fc5-75a77afc4299 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.057267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1131/2232] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:40.062280 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:40.079534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f25cc-e0f6-420a-af54-629cb700939a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.091186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.093051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.093809 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.094479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] PATH_INFO: `/v3/projects/cdc17071dc94443d9d6c6ad78e47349f/users/a2745da0cbdd4a5da68a2910cbe5e533/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.116555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc17071dc94443d9d6c6ad78e47349f, user_id=a2745da0cbdd4a5da68a2910cbe5e533, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.120607 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.138509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1102/2233] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:40 2022] PUT /identity/v3/projects/cdc17071dc94443d9d6c6ad78e47349f/users/a2745da0cbdd4a5da68a2910cbe5e533/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:40.149655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.149993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.150259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.181520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] MFA Rules not processed for user `a2745da0cbdd4a5da68a2910cbe5e533`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:40.182803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:40.193185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:40.197973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:40.199874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:40.256125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1132/2234] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:40.267265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:40.268645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:40.271108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734dc1-59d2-4aa4-a6b6-e21f15bee395 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.276124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.277035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.277349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.277683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] PATH_INFO: `/v3/users/5354b3376a424abdaa0427a7eb5aece1` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.278985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5354b3376a424abdaa0427a7eb5aece1)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.280980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.303753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:40.329103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ad14-d245-41db-a0a7-4896fae68ae5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.332907 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.333576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.333862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.334132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.334970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5354b3376a424abdaa0427a7eb5aece1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:40.343235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.344411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5354b3376a424abdaa0427a7eb5aece1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:40.344704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84244f0-225b-402e-aaf3-8b54e7cf1a18 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.353478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5354b3376a424abdaa0427a7eb5aece1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:40.354118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5354b3376a424abdaa0427a7eb5aece1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:40.354750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5354b3376a424abdaa0427a7eb5aece1'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:40.354852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1133/2235] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:26:40.379965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1103/2236] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:40 2022] DELETE /identity/v3/users/5354b3376a424abdaa0427a7eb5aece1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:40.387527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.387992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.388436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.416561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:40.418742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:40.505232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1134/2237] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:40.517895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:40.520001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:40.595511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f866c87-1db6-4516-ba1e-531302596922 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:40.599281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:40.599987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.600269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.600544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.612905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:40.614404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d67b1-91f8-4b0b-baf5-b2772e91ead4 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:40.628129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1104/2238] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:41.028239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.030685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.053940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085cb88-4879-4f7c-a2e7-2ca1fb64d83e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.062557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.063875 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.064345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.064810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] PATH_INFO: `/v3/projects/023ee7b2cb3e4253a75593a4808b33ad` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.067936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ee7b2cb3e4253a75593a4808b33ad)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.071251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.138882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ee7b2cb3e4253a75593a4808b33ad', 'request_id': 'req-65cc0a24-2067-4230-ba5a-afa341733340'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:41.140675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:41.149173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ee7b2cb3e4253a75593a4808b33ad', 'request_id': 'req-65cc0a24-2067-4230-ba5a-afa341733340'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:41.158033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ee7b2cb3e4253a75593a4808b33ad', 'request_id': 'req-65cc0a24-2067-4230-ba5a-afa341733340'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:41.170828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] The token cache is being invalidate because project 023ee7b2cb3e4253a75593a4808b33ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:41.171140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:41.171819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65cc0a24-2067-4230-ba5a-afa341733340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:41.173528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1135/2239] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:41 2022] DELETE /identity/v3/projects/023ee7b2cb3e4253a75593a4808b33ad => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:41.179265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.180368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.180835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.200823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:41.202114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.287880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1105/2240] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:41.303633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.304237 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.304713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.334892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:41.336600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.346987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1136/2241] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:41.353257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.364257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b57c63-de6f-46fb-8633-cfc32ba0d540 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.370147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.370899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.371220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.371664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.372447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:41.372769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.380565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.396075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1106/2242] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:41.398390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.411850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42390240-3ada-426f-aec7-0b78f0b74e1a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.417589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.418224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.418504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.418773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.419520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.422151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.459356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1137/2243] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:41.465978 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.482326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ae77-97cd-4042-91f2-96c10e489aee admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.523666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:41.579287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.580709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.581205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.581696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.583059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.587067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.622883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1107/2244] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:41.627910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.639730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aeb86-372c-47de-b98b-33d0ed417743 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.645471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.646315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.646603 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.646946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.647767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.649507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.662192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1138/2245] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:41.666380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.677244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3588-8e36-48f4-9b6b-8f38a5a2ec26 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.682258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.682941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.683226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.683539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.684288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.685931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8cefe-6352-4e33-a016-a11cae3d0301 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.701887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1108/2246] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:41.703501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.714444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7b1d-9b45-4168-9332-4ed5b8e0465d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.719527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.720439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.726437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.726437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] PATH_INFO: `/v3/projects/935b3dc7edc84636ae6b2ff155db2e86/users/b8a6158cd2714f349ce0ab0b8796e582/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.738569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935b3dc7edc84636ae6b2ff155db2e86, user_id=b8a6158cd2714f349ce0ab0b8796e582, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.741647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.758938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1139/2247] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:41 2022] PUT /identity/v3/projects/935b3dc7edc84636ae6b2ff155db2e86/users/b8a6158cd2714f349ce0ab0b8796e582/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:41.764466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e059-4fba-45b9-af9b-64dc9c9a9099 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.764938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e059-4fba-45b9-af9b-64dc9c9a9099 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.765290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e059-4fba-45b9-af9b-64dc9c9a9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.789542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b689e059-4fba-45b9-af9b-64dc9c9a9099 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:41.790759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b689e059-4fba-45b9-af9b-64dc9c9a9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.862333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1109/2248] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:41.875452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.878076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:42.018965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47f37-28a9-4324-a7df-2b9b6ddd5c57 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:42.023578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:42.024347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:42.024703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:42.025035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:42.038134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:42.040059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:42.053255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1140/2249] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:42.937279 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f299-16f6-49c3-8f2c-6ad54f8948c4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:42.937876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f299-16f6-49c3-8f2c-6ad54f8948c4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:42.937876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f299-16f6-49c3-8f2c-6ad54f8948c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:42.968128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bdb9f299-16f6-49c3-8f2c-6ad54f8948c4 None None] MFA Rules not processed for user `b8a6158cd2714f349ce0ab0b8796e582`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:42.969639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bdb9f299-16f6-49c3-8f2c-6ad54f8948c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:43.049742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1110/2250] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:43.061488 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:43.063232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:43.128690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8e6a0-db73-4e5a-be4a-f856a92cf321 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:43.134543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:43.135822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:43.136438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:43.137133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:43.151269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:43.152790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:43.165544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1141/2251] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:44.649567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38da3-7d4a-4285-b8f5-b267f14fbc9c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:44.649567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38da3-7d4a-4285-b8f5-b267f14fbc9c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:44.649567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38da3-7d4a-4285-b8f5-b267f14fbc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:44.668023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-41c38da3-7d4a-4285-b8f5-b267f14fbc9c None None] MFA Rules not processed for user `b8a6158cd2714f349ce0ab0b8796e582`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:44.669242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-41c38da3-7d4a-4285-b8f5-b267f14fbc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:44.680292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1111/2252] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:51.054372 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:51.056025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.081116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12709bd-acc3-44a2-8b14-20d902930db7 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:51.085997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:51.086882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.087166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.087472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] PATH_INFO: `/v3/users/a2745da0cbdd4a5da68a2910cbe5e533` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.088688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2745da0cbdd4a5da68a2910cbe5e533)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:51.090637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:51.106005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=3,keystone:DELETE=4,keystone:SELECT=93 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:51.143537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2745da0cbdd4a5da68a2910cbe5e533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:51.153988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2745da0cbdd4a5da68a2910cbe5e533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:51.169088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2745da0cbdd4a5da68a2910cbe5e533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:51.169930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2745da0cbdd4a5da68a2910cbe5e533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:51.177688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2745da0cbdd4a5da68a2910cbe5e533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:51.183931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1142/2253] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:51 2022] DELETE /identity/v3/users/a2745da0cbdd4a5da68a2910cbe5e533 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:51.188507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.189017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.189246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.208177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:51.209400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.234474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:51.275442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1112/2254] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:51.286157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:51.287835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.353253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7900d1c-8f2e-4e46-b6f2-4e401a21d215 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:51.357208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:51.357868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.358151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.358433 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.369840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:51.371535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1626-b69b-470b-bb26-99d4fd811929 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:51.385620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1143/2255] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:51.824537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:51.826643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.849201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aead5-7219-4ce0-97fe-bd91693f3217 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:51.865665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:51.867795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.870619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.873380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] PATH_INFO: `/v3/projects/cdc17071dc94443d9d6c6ad78e47349f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.883993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc17071dc94443d9d6c6ad78e47349f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:51.908832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:52.068069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc17071dc94443d9d6c6ad78e47349f', 'request_id': 'req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:52.085099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc17071dc94443d9d6c6ad78e47349f', 'request_id': 'req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:52.098389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc17071dc94443d9d6c6ad78e47349f', 'request_id': 'req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:52.126959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] The token cache is being invalidate because project cdc17071dc94443d9d6c6ad78e47349f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:52.127519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:52.128833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e4c1aebc-b7f5-4444-b9d2-33a24a84c1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:52.132211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1113/2256] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:51 2022] DELETE /identity/v3/projects/cdc17071dc94443d9d6c6ad78e47349f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:58.733181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f23e-4325-41fa-8380-84a95bdb3657 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:58.734437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f23e-4325-41fa-8380-84a95bdb3657 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:58.734879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f23e-4325-41fa-8380-84a95bdb3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:58.755909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-11d1f23e-4325-41fa-8380-84a95bdb3657 None None] MFA Rules not processed for user `f6c8fbe67885443b8e373c8af032f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:58.757186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-11d1f23e-4325-41fa-8380-84a95bdb3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:58.835658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1144/2257] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:02.117377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:03.475753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:03.476426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:03.476426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:03.500274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] MFA Rules not processed for user `098429887fdb41ddb00c7a50cc5d54fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:03.504210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:03.585203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1114/2258] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:08.830685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=72,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:13.577030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=25 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:23.169314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f045f8-0c85-4ab8-b4fa-d5002c061aeb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:23.169968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f045f8-0c85-4ab8-b4fa-d5002c061aeb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:23.169968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f045f8-0c85-4ab8-b4fa-d5002c061aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:23.191846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c6f045f8-0c85-4ab8-b4fa-d5002c061aeb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:23.193314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c6f045f8-0c85-4ab8-b4fa-d5002c061aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:23.264509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1145/2259] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:23.290202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:23.291753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:23.370146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66531f-7868-4302-93e2-411c5b3784dd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:23.378004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:23.379031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:23.379584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:23.379988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:23.390488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:23.392557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:23.404210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1115/2260] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:26.206457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8662d9-cdd7-4c41-b0c2-a5fb579011c8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:26.207143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8662d9-cdd7-4c41-b0c2-a5fb579011c8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:26.207143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8662d9-cdd7-4c41-b0c2-a5fb579011c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:26.226573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-be8662d9-cdd7-4c41-b0c2-a5fb579011c8 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:26.227852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-be8662d9-cdd7-4c41-b0c2-a5fb579011c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:26.237042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1146/2261] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:26.272002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:26.273579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:26.290084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc8c3-9353-442c-8ace-ef775d336d9d service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:26.297013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:26.297659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:26.298029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:26.298302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:26.307900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:26.309525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:26.320706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1116/2262] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:30.517681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45adc2-8745-4364-ba85-f869fad1b692 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:30.518264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45adc2-8745-4364-ba85-f869fad1b692 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:30.518264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45adc2-8745-4364-ba85-f869fad1b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:30.540357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc45adc2-8745-4364-ba85-f869fad1b692 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:30.541604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc45adc2-8745-4364-ba85-f869fad1b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:30.551384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1147/2263] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:30.572956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:30.588636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd11b-c19b-441c-a351-034cc68825f9 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:30.595075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:30.596060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:30.596616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:30.597518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:30.608611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:30.610651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:30.621858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1117/2264] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:34.663726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242fee-11c9-43d0-aa42-191821efeee2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:34.664367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242fee-11c9-43d0-aa42-191821efeee2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:34.664367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242fee-11c9-43d0-aa42-191821efeee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:34.686365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9c242fee-11c9-43d0-aa42-191821efeee2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:34.687650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9c242fee-11c9-43d0-aa42-191821efeee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:34.701185 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1148/2265] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:34.729841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:34.743247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beacc6-7cce-46df-8c0e-e51604f5b93e service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:34.750213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:34.751031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:34.751380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:34.751716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:34.762164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:34.764378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:34.776630 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1118/2266] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:38.910060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c368e-bc3a-42b3-8785-401e821d2663 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:38.910554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c368e-bc3a-42b3-8785-401e821d2663 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:38.910633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c368e-bc3a-42b3-8785-401e821d2663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:38.931041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c3c368e-bc3a-42b3-8785-401e821d2663 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:38.932351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c3c368e-bc3a-42b3-8785-401e821d2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:38.940579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1149/2267] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:38.965382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:38.977847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03784e81-8279-41be-a6f9-376b2c841932 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:38.983964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:38.984726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:38.985159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:38.985510 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:38.995695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:38.997729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:39.009060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1119/2268] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:43.123195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b7fa-c300-4e53-a7fc-3984e34dbf63 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:43.123798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b7fa-c300-4e53-a7fc-3984e34dbf63 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:43.123798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b7fa-c300-4e53-a7fc-3984e34dbf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:43.143262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d5b2b7fa-c300-4e53-a7fc-3984e34dbf63 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:43.144618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d5b2b7fa-c300-4e53-a7fc-3984e34dbf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:43.153935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1150/2269] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:43.181127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:43.193436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75542c17-ca5e-46e0-9ae7-8aaa15052187 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:43.201133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:43.201861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:43.202150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:43.202421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:43.212785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:43.214403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:43.225700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1120/2270] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:53.137470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=42 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:53.220596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=64 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:00.682762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab328-d468-4411-a726-b4edef5b463a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:00.683360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab328-d468-4411-a726-b4edef5b463a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:00.683360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab328-d468-4411-a726-b4edef5b463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:00.701812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b1aab328-d468-4411-a726-b4edef5b463a None None] MFA Rules not processed for user `b8a6158cd2714f349ce0ab0b8796e582`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:00.703057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b1aab328-d468-4411-a726-b4edef5b463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:00.765278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1151/2271] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:28:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:01.881875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:01.883494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:01.960116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0cbc6-b259-499d-a16d-3b9be53dbd79 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:01.967759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:01.968628 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:01.968895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:01.969318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:01.971724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:01.985119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:01.986645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:01.998553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1121/2272] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:02.356256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcce20-18bd-4b8c-affc-dd32582e9006 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.356757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcce20-18bd-4b8c-affc-dd32582e9006 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.356865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcce20-18bd-4b8c-affc-dd32582e9006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.376075 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6bfcce20-18bd-4b8c-affc-dd32582e9006 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:02.377316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6bfcce20-18bd-4b8c-affc-dd32582e9006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:02.438378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1152/2273] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:02.481991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:02.483537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:02.563043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbade9c-be1f-4ddb-823c-e21062d54df2 service placement] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:02.568128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:02.568795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.569075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.569348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.578539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:02.580255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:02.589519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1122/2274] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:12.431588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=50 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:12.586583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=64 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:19.270061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191ff1-deb4-4f33-a0c6-92d952544e77 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:19.276521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191ff1-deb4-4f33-a0c6-92d952544e77 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:19.277985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191ff1-deb4-4f33-a0c6-92d952544e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:19.320537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-46191ff1-deb4-4f33-a0c6-92d952544e77 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:19.322384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46191ff1-deb4-4f33-a0c6-92d952544e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:19.338029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1153/2275] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:19.476437 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:19.490872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e54c-c163-4a03-b71d-dcd49cbdb063 service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:19.498157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:19.499040 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:19.499427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:19.499778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:19.509875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:19.511551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07b655-9bed-4865-affa-e68019f1d471 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:19.522503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1123/2276] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:19.933821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:19.934575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:19.934906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:19.937241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1154/2277] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:19.944010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945abb-990a-41b3-9fd6-4611c0feea51 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:19.944304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945abb-990a-41b3-9fd6-4611c0feea51 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:19.944576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945abb-990a-41b3-9fd6-4611c0feea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:19.967351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e5945abb-990a-41b3-9fd6-4611c0feea51 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:19.968897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e5945abb-990a-41b3-9fd6-4611c0feea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:19.978984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1124/2278] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:19.991823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:19.993553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:20.056523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a86f95-9782-429a-9ff2-8b6488f4f19f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:20.061986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:20.062673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.062946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.063223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.075182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:20.076752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a493147-79db-48d8-bebd-f56135744f3e service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:20.088833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1155/2279] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:20.166696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.167068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.167470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.169119 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1125/2280] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:20.176775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68e6c-c154-4909-a075-952c50f1aea6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.177415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68e6c-c154-4909-a075-952c50f1aea6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.177847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68e6c-c154-4909-a075-952c50f1aea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.208522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c0f68e6c-c154-4909-a075-952c50f1aea6 None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:20.210555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c0f68e6c-c154-4909-a075-952c50f1aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:20.285360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1156/2281] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:20.297626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:20.300003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:20.315713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b804b86-dee1-4563-b96c-0befad996143 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:20.319486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:20.320244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.320528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.320989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.330148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:20.331769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddab13-387f-4bdc-92e6-0a08f244c0ba service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:20.340555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1126/2282] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:20.427872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc1b-bc60-428d-923a-5ae7b7a27d7e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.428472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc1b-bc60-428d-923a-5ae7b7a27d7e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.428753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc1b-bc60-428d-923a-5ae7b7a27d7e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.430325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1157/2283] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:20.436240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762afa-833b-4f80-97b6-d28ed52af0c8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.436525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762afa-833b-4f80-97b6-d28ed52af0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.436839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762afa-833b-4f80-97b6-d28ed52af0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.459108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f6762afa-833b-4f80-97b6-d28ed52af0c8 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:20.460517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f6762afa-833b-4f80-97b6-d28ed52af0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:20.471989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1127/2284] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:20.486918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc1b-bc60-428d-923a-5ae7b7a27d7e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:20.499849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc1b-bc60-428d-923a-5ae7b7a27d7e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:20.513715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:20.514566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:20.514911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:20.515253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:20.540336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:20.541974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:20.555236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1158/2285] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:22.784436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4ac51-ff0b-4b25-a3cc-7d05df6642af None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:22.785036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4ac51-ff0b-4b25-a3cc-7d05df6642af None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:22.785162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4ac51-ff0b-4b25-a3cc-7d05df6642af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:22.807673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d1d4ac51-ff0b-4b25-a3cc-7d05df6642af None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:22.809141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d1d4ac51-ff0b-4b25-a3cc-7d05df6642af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:22.819151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1128/2286] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:22.849971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:22.863859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67187d4-dc1d-41de-b05a-237d117e84fc service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:22.873623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:22.875295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:22.875885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:22.876418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:22.887462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:22.889085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:22.900601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1159/2287] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:28.032222 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515df9-d199-401e-ab54-ff2de72459c4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:28.032785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515df9-d199-401e-ab54-ff2de72459c4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:28.032785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515df9-d199-401e-ab54-ff2de72459c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:28.054875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-94515df9-d199-401e-ab54-ff2de72459c4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:28.056565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-94515df9-d199-401e-ab54-ff2de72459c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:28.066933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1129/2288] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:28.093882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:28.107818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09ded3-38b9-461a-a69d-9d6c9c5df049 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:28.115365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:28.116041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:28.116322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:28.116596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:28.126693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:28.128423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:28.139723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1160/2289] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:28:30.505810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203485d-46ee-4f78-a330-0aa794715ef0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:30.506394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203485d-46ee-4f78-a330-0aa794715ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:30.506394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203485d-46ee-4f78-a330-0aa794715ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:30.525467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d203485d-46ee-4f78-a330-0aa794715ef0 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:30.526703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d203485d-46ee-4f78-a330-0aa794715ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:30.535328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1130/2290] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:30.547852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:30.560371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf7f2-b354-467f-bd61-abca34deea96 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:30.567807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:30.568505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:30.568783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:30.569057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:30.581122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:30.582788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:30.592274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1161/2291] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:31.249921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bd6b-1c06-48f3-99a9-c637f43b38fd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.250477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bd6b-1c06-48f3-99a9-c637f43b38fd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.250913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bd6b-1c06-48f3-99a9-c637f43b38fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.284884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a582bd6b-1c06-48f3-99a9-c637f43b38fd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:31.289255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a582bd6b-1c06-48f3-99a9-c637f43b38fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:31.299586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1131/2292] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:31.324758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:31.346840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954df396-61b7-4787-89b8-d2d2f48c1796 service swift] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:31.362597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:31.363642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.364095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.364369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.375681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:31.377170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d615d08-f0e0-4a5f-af00-2b805e004e7f service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:31.404445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1162/2293] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:28:33.842197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:33.842858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:33.842858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:33.861988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] MFA Rules not processed for user `f6c8fbe67885443b8e373c8af032f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:33.875141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:33.886791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1132/2294] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:41.383955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=82 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:43.856341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=33 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:45.882832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd2e4c-ac2a-462f-9603-e96024509cde None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:45.883429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd2e4c-ac2a-462f-9603-e96024509cde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:45.883552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd2e4c-ac2a-462f-9603-e96024509cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:45.917255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2ffd2e4c-ac2a-462f-9603-e96024509cde None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:45.918978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2ffd2e4c-ac2a-462f-9603-e96024509cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:45.936127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1163/2295] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:45.972781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:45.989512 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f775-dd89-4b99-b1d6-1bc99e830353 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:45.995563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:45.996592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:45.997022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:45.997438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:46.006905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:46.009117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb20630-3e5c-48a2-89fc-a8856f7e2f6a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:46.034576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1133/2296] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:50.805916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:50.806576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:50.806576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:50.826497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] MFA Rules not processed for user `098429887fdb41ddb00c7a50cc5d54fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:50.827840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:50.836668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1164/2297] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:51.502753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb123-22f0-4c0d-bbfb-8b6d4a087e3e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:51.503365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb123-22f0-4c0d-bbfb-8b6d4a087e3e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:51.503476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb123-22f0-4c0d-bbfb-8b6d4a087e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:51.531975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9baeb123-22f0-4c0d-bbfb-8b6d4a087e3e None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:51.533588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9baeb123-22f0-4c0d-bbfb-8b6d4a087e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:51.541746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1134/2298] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:51.554869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:51.567081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f52ca9-d1de-4b25-a83e-7e06270f27a9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:51.572213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:51.572893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:51.573180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:51.573458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:51.582363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:51.584143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:51.593296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1165/2299] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:01.524450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=9 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:01.589632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=12 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:17.807582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:17.808296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:17.808296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:17.837353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] MFA Rules not processed for user `048ff38a084747338fb6d69ed0ab9644`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:17.839228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:17.917503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1135/2300] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:24.320012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:24.321714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:24.337011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54d9d1-acaf-4ec0-8dfb-1ed257205fbf service swift] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:24.342963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:24.343874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:24.344145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:24.344425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] PATH_INFO: `/v3/users/b8a6158cd2714f349ce0ab0b8796e582` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:24.345751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a6158cd2714f349ce0ab0b8796e582)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:24.347791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:24.403584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a6158cd2714f349ce0ab0b8796e582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.412522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a6158cd2714f349ce0ab0b8796e582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.428268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a6158cd2714f349ce0ab0b8796e582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.429034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a6158cd2714f349ce0ab0b8796e582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.436376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-08c83457-3830-4f6d-9e39-c80b37a4355e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a6158cd2714f349ce0ab0b8796e582'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.442539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1166/2301] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:29:24 2022] DELETE /identity/v3/users/b8a6158cd2714f349ce0ab0b8796e582 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:29:24.631922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:24.644231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a08f8-9007-4d63-911f-3aea9d69abce None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:24.713798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:24.714746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:24.715029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:24.715298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] PATH_INFO: `/v3/projects/935b3dc7edc84636ae6b2ff155db2e86` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:24.716621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] RBAC: Authorizing `identity:delete_project(project_id=935b3dc7edc84636ae6b2ff155db2e86)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:24.718650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:24.771536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935b3dc7edc84636ae6b2ff155db2e86', 'request_id': 'req-afb4ec22-5c5a-431d-9102-5a0c75a0834c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.778347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935b3dc7edc84636ae6b2ff155db2e86', 'request_id': 'req-afb4ec22-5c5a-431d-9102-5a0c75a0834c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.789529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935b3dc7edc84636ae6b2ff155db2e86', 'request_id': 'req-afb4ec22-5c5a-431d-9102-5a0c75a0834c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.801378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] The token cache is being invalidate because project 935b3dc7edc84636ae6b2ff155db2e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:29:24.801632 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.802311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:24.804409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1136/2302] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:29:24 2022] DELETE /identity/v3/projects/935b3dc7edc84636ae6b2ff155db2e86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:29:34.438862 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:34.798069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:43.112003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:43.112569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:43.112569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:43.134160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] MFA Rules not processed for user `ef28fef252ed4dcfb7815b4150a18cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:43.135388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:43.201383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1167/2303] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:52.495151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:52.496654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:52.564832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ec22-5c5a-431d-9102-5a0c75a0834c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:52.573904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:52.574583 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:52.574862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:52.575252 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:52.577291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:52.682247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:52.684289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:52.696231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1137/2304] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:53.193498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=25 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:56.562837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:56.564498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:56.625235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e4763-1e5b-4b06-8e49-178c4357e788 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:56.629620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:56.630287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:56.630577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:56.630857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:56.632945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:56.694410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:56.695951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:56.705285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1168/2305] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:57.472214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:57.483406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f8784-c56d-4b67-8a89-a3e1d3670740 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:57.487908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:57.488557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:57.488841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:57.489116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:57.491192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:57.507633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:57.509129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323d72-a79f-4bf1-9b78-61a1aed72e56 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:57.521051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1138/2306] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:30:06.700817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=48 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:07.515696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=60 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:10.069970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:10.071700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:10.083934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d7bd-a5b5-4466-abed-f132e1fc8232 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:10.088087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:10.088720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:10.089010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:10.089298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:10.091141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:10.158496 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:10.160114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:10.175212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1169/2307] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:12.126965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:12.127613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:12.127731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:12.147151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] MFA Rules not processed for user `f6c8fbe67885443b8e373c8af032f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:12.148441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:12.211294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1139/2308] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:12.545041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:12.554709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc5ca-2047-4aee-89a9-f32f633009a3 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:12.558876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:12.559758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:12.560082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:12.560447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:12.562331 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:12.575383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:12.577022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:12.587721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1170/2309] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:12.940165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:12.942045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:13.027234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abca890-f5f2-4cb1-a16b-6c4490a7704f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:13.035981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:13.036664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:13.036949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:13.037224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:13.039103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:13.052649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:13.054318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:13.066852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1140/2310] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:14.177575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:14.180016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:14.196122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a14cd6-b29c-44f5-8cd4-c0d0fe81406b service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:14.201508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:14.202484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.202836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.203124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] PATH_INFO: `/v3/users/098429887fdb41ddb00c7a50cc5d54fa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.204389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098429887fdb41ddb00c7a50cc5d54fa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:14.206637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:14.257763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098429887fdb41ddb00c7a50cc5d54fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.267006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098429887fdb41ddb00c7a50cc5d54fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.282983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098429887fdb41ddb00c7a50cc5d54fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.283807 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098429887fdb41ddb00c7a50cc5d54fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.293506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9fddb182-02ed-4735-8c76-caa5adbc4b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098429887fdb41ddb00c7a50cc5d54fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.302780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1171/2311] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:14 2022] DELETE /identity/v3/users/098429887fdb41ddb00c7a50cc5d54fa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:14.502010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:14.514496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f48e7-b41f-4755-bea7-9a0c803c501b service placement] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:14.587654 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:14.588537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.588815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.589338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] PATH_INFO: `/v3/projects/0798cac60e864329a8ac6ce61e87ce75` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.590733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0798cac60e864329a8ac6ce61e87ce75)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:14.592731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:14.633565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:14.649137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0798cac60e864329a8ac6ce61e87ce75', 'request_id': 'req-91b6e599-1378-4ff7-9e8c-378f7e788f1c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.656218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0798cac60e864329a8ac6ce61e87ce75', 'request_id': 'req-91b6e599-1378-4ff7-9e8c-378f7e788f1c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.666108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0798cac60e864329a8ac6ce61e87ce75', 'request_id': 'req-91b6e599-1378-4ff7-9e8c-378f7e788f1c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.677448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] The token cache is being invalidate because project 0798cac60e864329a8ac6ce61e87ce75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:14.677735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.678385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-91b6e599-1378-4ff7-9e8c-378f7e788f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:14.680004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1141/2312] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:14 2022] DELETE /identity/v3/projects/0798cac60e864329a8ac6ce61e87ce75 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:14.691117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.691473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.691730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.710647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:14.711914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:14.762681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:14.778914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1172/2313] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:14.787425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.787717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.788031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.807114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:14.808509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:14.817356 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1142/2314] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:14.822314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:14.833843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4c7b-429c-4332-83f6-44c29a4105a7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:14.839411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:14.840103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.840406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.840687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.841550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:14.841806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:14.843514 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:14.859597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1173/2315] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:30:14.863781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:14.874157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac353a-3cd3-487e-a854-40d43cd318ef None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:14.879273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:14.880000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.880278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.880545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.881257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:14.883248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:14.913164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1143/2316] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:14 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:14.917697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:14.928440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5d88-3454-449e-bde4-1f2351d8e829 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:14.992401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:14.993089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:14.993392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:14.993649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:14.994376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:14.996411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.018298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1174/2317] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:14 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:15.022524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.033785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56bb2-74f6-499a-8b13-20a9f1012558 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.038835 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.039689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.040099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.040390 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.041502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.042961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.054805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1144/2318] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:15.059081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.070391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2498b0-0cd6-4319-8691-b97085c734cd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.075092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.075803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.076091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.076385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.077163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.078776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.100042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1175/2319] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:15.104392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.119474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98d792-3d41-45f6-8b6a-53caed62e139 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.141186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.144409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.144704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.144989 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] PATH_INFO: `/v3/projects/a835b9212f1b46ab90d21c209c68ed73/users/2096124535314674b2cdd8e8a62b154b/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.181765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a835b9212f1b46ab90d21c209c68ed73, user_id=2096124535314674b2cdd8e8a62b154b, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.191965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7be6d-5876-4842-94d2-62fd30744500 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.219048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.223906 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1145/2320] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:15 2022] PUT /identity/v3/projects/a835b9212f1b46ab90d21c209c68ed73/users/2096124535314674b2cdd8e8a62b154b/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:15.225903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.235892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.236187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.236467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.270090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] MFA Rules not processed for user `2096124535314674b2cdd8e8a62b154b`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:15.271694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.297256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43a12-3c33-4ef8-a9ee-c95072175981 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.361706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1146/2321] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:15.365062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.365984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.366468 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.366806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.367159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.369450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.382893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.384477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.394299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1176/2322] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:15.433102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:15.450406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7401c6-27a2-418b-b9f9-7bf1a3e3a955 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.456780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.457470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.457756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.458608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.459260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.459656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.461138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.461273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.497357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1147/2323] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:15 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:15.497909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:15.501348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.572787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337028-3042-4df2-9bb9-7cf0da71a9e6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.582340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494cf3f-002d-4351-9d92-e8dfbdf8b8c3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.589116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.590460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.590902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.591380 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.592732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.594885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.627346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1148/2324] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:15 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:30:15.629739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.641060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe18-8d6c-47fc-a3d5-d58186eb87a5 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.650583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.651382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.651511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.651729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.652008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.652422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.652875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.653213 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.653992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.654109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.656151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.667203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1149/2325] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:15.671650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.683442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663a49-85c5-4b12-9e6f-4a837abd6de9 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.690092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.691882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.692318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.692801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] PATH_INFO: `/v3/projects/b29065c91ef1481b8e09d539a27c1aa0/users/f8c1d70473bb4293ac4d9854df5d8640/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.711874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29065c91ef1481b8e09d539a27c1aa0, user_id=f8c1d70473bb4293ac4d9854df5d8640, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.714775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.724378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.726103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.735696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1150/2326] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:15 2022] PUT /identity/v3/projects/b29065c91ef1481b8e09d539a27c1aa0/users/f8c1d70473bb4293ac4d9854df5d8640/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:30:15.736268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1177/2327] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:30:15.739579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.816136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ab14-9ab5-4c7d-9e3b-096632b3355f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.821786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.822818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.822946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.823181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.823957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.825979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd332-89c0-42cf-ab6a-3dc6f2eda567 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.838881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1151/2328] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:15.844556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:15.866587 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dedbf4-affb-4a9c-890a-42590c4e1dc1 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:15.875108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:15.876738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.876738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.877031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] PATH_INFO: `/v3/projects/b29065c91ef1481b8e09d539a27c1aa0/users/f8c1d70473bb4293ac4d9854df5d8640/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.879973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29065c91ef1481b8e09d539a27c1aa0, user_id=f8c1d70473bb4293ac4d9854df5d8640, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:15.883435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:15.896043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1178/2329] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:15 2022] PUT /identity/v3/projects/b29065c91ef1481b8e09d539a27c1aa0/users/f8c1d70473bb4293ac4d9854df5d8640/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:15.906448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:15.906843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:15.907420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:15.943258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] MFA Rules not processed for user `f8c1d70473bb4293ac4d9854df5d8640`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:15.945046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:15.968594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:16.075351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1152/2330] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:16.087709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:16.099062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:16.192166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:16.216937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9829ae-e4ec-4347-9da2-3bf0e44e8517 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:16.222627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:16.224107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:16.224394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:16.224719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:16.243153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:16.244708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:16.261301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1179/2331] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:16.310518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:16.312192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:16.326346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df77c-f586-493d-aea4-4531c828ef3c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:16.330265 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:16.331022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:16.331262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:16.331702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:16.431287 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:16.433144 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:16.445362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1153/2332] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:17.539726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:17.635189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7d60-913a-49df-8cab-f9ffdd8a1973 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:17.651140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:17.653361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:17.653943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:17.654172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:17.657650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:17.755123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:17.759706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba443f-230a-47c2-a988-0c787fb1650f service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:17.773477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1180/2333] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:19.924017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:19.996419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e5d-19dc-4aa1-b78d-d821b09ea59b service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:20.002567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:20.003532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:20.003806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:20.004072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] PATH_INFO: `/v3/users/2096124535314674b2cdd8e8a62b154b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:20.005264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2096124535314674b2cdd8e8a62b154b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:20.007237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:20.066568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2096124535314674b2cdd8e8a62b154b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.070963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:20.074104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2096124535314674b2cdd8e8a62b154b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.084462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2096124535314674b2cdd8e8a62b154b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.084891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2096124535314674b2cdd8e8a62b154b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.085627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2096124535314674b2cdd8e8a62b154b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.115371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1154/2334] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:19 2022] DELETE /identity/v3/users/2096124535314674b2cdd8e8a62b154b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:20.117691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:20.118232 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:20.118596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:20.139255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:20.140663 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:20.220428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1181/2335] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:20.231791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:20.233136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:20.311610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a998b-ca4e-4616-a194-11d7e7747877 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:20.317735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:20.318486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:20.318832 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:20.319166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:20.333804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:20.335364 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:20.346154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1155/2336] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:30:20.654390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:20.656435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:20.672320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ff61-d371-4147-8f52-5c5440f6e07b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:20.677704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:20.678592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:20.678899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:20.679210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] PATH_INFO: `/v3/projects/a835b9212f1b46ab90d21c209c68ed73` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:20.680389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a835b9212f1b46ab90d21c209c68ed73)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:20.682368 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:20.698670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:20.732905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a835b9212f1b46ab90d21c209c68ed73', 'request_id': 'req-66b89fe6-e406-4c22-b42a-b169d6841b26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.743042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a835b9212f1b46ab90d21c209c68ed73', 'request_id': 'req-66b89fe6-e406-4c22-b42a-b169d6841b26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.750491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a835b9212f1b46ab90d21c209c68ed73', 'request_id': 'req-66b89fe6-e406-4c22-b42a-b169d6841b26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.761953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] The token cache is being invalidate because project a835b9212f1b46ab90d21c209c68ed73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:20.762240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.763725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.765364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1182/2337] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:20 2022] DELETE /identity/v3/projects/a835b9212f1b46ab90d21c209c68ed73 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:20.769890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:20.783483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf3c92-b2bf-4246-a21a-ca7f470dd70f service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:20.846897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:20.847871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:20.848093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:20.848369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] PATH_INFO: `/v3/users/f8c1d70473bb4293ac4d9854df5d8640` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:20.849602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c1d70473bb4293ac4d9854df5d8640)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:20.851661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:20.902120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c1d70473bb4293ac4d9854df5d8640'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.909489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c1d70473bb4293ac4d9854df5d8640'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.918677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c1d70473bb4293ac4d9854df5d8640'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.919323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c1d70473bb4293ac4d9854df5d8640'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.919993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-047a0ec3-5ab6-451e-bda5-9036cc355ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c1d70473bb4293ac4d9854df5d8640'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:20.928975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:20.940385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1156/2338] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:20 2022] DELETE /identity/v3/users/f8c1d70473bb4293ac4d9854df5d8640 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:21.237072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.238689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:21.252786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89fe6-e406-4c22-b42a-b169d6841b26 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.320464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.321345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.321664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.321937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] PATH_INFO: `/v3/projects/b29065c91ef1481b8e09d539a27c1aa0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.323171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29065c91ef1481b8e09d539a27c1aa0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.325211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.380023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29065c91ef1481b8e09d539a27c1aa0', 'request_id': 'req-b2b9c063-abcb-4b63-bad4-1efcd8045e00'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:21.390362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29065c91ef1481b8e09d539a27c1aa0', 'request_id': 'req-b2b9c063-abcb-4b63-bad4-1efcd8045e00'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:21.400658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29065c91ef1481b8e09d539a27c1aa0', 'request_id': 'req-b2b9c063-abcb-4b63-bad4-1efcd8045e00'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:21.413332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] The token cache is being invalidate because project b29065c91ef1481b8e09d539a27c1aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:21.413641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:21.414313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b2b9c063-abcb-4b63-bad4-1efcd8045e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:21.416245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1183/2339] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:21 2022] DELETE /identity/v3/projects/b29065c91ef1481b8e09d539a27c1aa0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:21.421466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.421755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.422033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.439991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:21.441319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:21.514817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1157/2340] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:21.522644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.522939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.523214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.561850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:21.563069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:21.574020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1184/2341] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:21.578544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.590519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4bbaf-985b-4b78-a2da-659990cdba31 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.596627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.596627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.596627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.596951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.597905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:21.598100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.599667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.614459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1158/2342] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:21.618240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.632491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462bd2-29a0-403c-a007-e9f07d64901f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.637731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.638607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.638742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.639080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.639778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.641919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.673257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1185/2343] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:21 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:21.678371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.691254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3b927-d1e4-46de-93fe-787a3b54722a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.768177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.768916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.769270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.769542 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.770245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.772249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.796264 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1159/2344] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:21 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:21.800416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.816823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:21.826396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18bd7-7f61-4d5b-b373-3d5c9939ac30 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.837202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.838373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.838684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.839008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.840061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.842194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.854572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1186/2345] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:21.858722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.872954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e62b2-fd73-4471-8a53-dcbf61bd418c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.880633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.881326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.881604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.881876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.882614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.884313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b5c94-d5c6-42f5-a1b1-1bca217f4cd1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.896293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1160/2346] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:21.903166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:21.924323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec22c1-c8c6-4032-ae3a-5d57eb7621e9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:21.930303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:21.931215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.931549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.931861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] PATH_INFO: `/v3/projects/876c00fbe130440b874e8c99cd971db3/users/74d892b2a04a4586b9c59ad055182686/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:21.953247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=876c00fbe130440b874e8c99cd971db3, user_id=74d892b2a04a4586b9c59ad055182686, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:21.956034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:21.980181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1187/2347] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:21 2022] PUT /identity/v3/projects/876c00fbe130440b874e8c99cd971db3/users/74d892b2a04a4586b9c59ad055182686/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:21.991923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:21.992473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:21.992473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.027784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] MFA Rules not processed for user `74d892b2a04a4586b9c59ad055182686`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:22.027784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:22.075173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:22.100853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1161/2348] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:22.105896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.168999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f241-7d29-4c27-a284-2aa466751eed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.173975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.174648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.174936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.175166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.175943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.177860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.206197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1188/2349] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:22.211389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.226253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965c05-de4a-46cb-a788-928d1063f34c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.298191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.298817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.299105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.299450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.300157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.302445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.324271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1162/2350] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:22 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:30:22.328769 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.340594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b709fb-0576-4b9c-8b86-141ef0b508dd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.345861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.346497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.346839 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.347143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.347919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.349553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.361464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1189/2351] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:22.366064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.376804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed0c6-f6dd-4653-b4ea-71a01926ee53 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.382767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.383689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.383966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.384234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] PATH_INFO: `/v3/projects/4007955cd52a45e485a87bf40667f033/users/07127cf5aa764181a43f4dba5fbf5035/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.400838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4007955cd52a45e485a87bf40667f033, user_id=07127cf5aa764181a43f4dba5fbf5035, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.403582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.422206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1163/2352] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:22 2022] PUT /identity/v3/projects/4007955cd52a45e485a87bf40667f033/users/07127cf5aa764181a43f4dba5fbf5035/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:22.427072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.438594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37748-e6ab-4264-9c8a-14041d1497ad admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.499541 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.500218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.500495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.500765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.501469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.503078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf3b-18da-4bbd-8959-8b70a5851b62 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.513844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1190/2353] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:22.519861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.530877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf3cff-d3e6-4ac5-9eb6-2debde7b91eb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.535953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.536838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.537116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.537385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] PATH_INFO: `/v3/projects/4007955cd52a45e485a87bf40667f033/users/07127cf5aa764181a43f4dba5fbf5035/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.539522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4007955cd52a45e485a87bf40667f033, user_id=07127cf5aa764181a43f4dba5fbf5035, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.542186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.554016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1164/2354] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:22 2022] PUT /identity/v3/projects/4007955cd52a45e485a87bf40667f033/users/07127cf5aa764181a43f4dba5fbf5035/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:22.564576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.564869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.565152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.593344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] MFA Rules not processed for user `07127cf5aa764181a43f4dba5fbf5035`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:22.594600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:22.625853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:22.671990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1191/2355] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:22.683465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:22.685261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:22.743403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07253-5b63-43d2-b683-5934d82798bf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:22.747494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:22.748148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:22.748423 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:22.748671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:22.803914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:22.809594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:22.812146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:22.827527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1165/2356] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:24.207988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:24.219393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928d48-86f9-4aa8-995c-3136876d14b0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:24.223492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:24.224397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:24.224682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:24.224961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:24.236042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:24.237524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:24.252786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1192/2357] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:26.288310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:26.290131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:26.372438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34079aa-ba95-4f34-8979-ecba64cf675f service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:26.378096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:26.378753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:26.379031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:26.379299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:26.381285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:26.394107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:26.395893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb13870-9777-4950-973b-a01390bb6b0a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:26.407480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1166/2358] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:28.340532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:28.408726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5cd5-948b-408f-97c1-c2b50e75c68c service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:28.413696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:28.414661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:28.414981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:28.415259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] PATH_INFO: `/v3/users/74d892b2a04a4586b9c59ad055182686` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:28.416549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d892b2a04a4586b9c59ad055182686)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:28.418478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:28.470357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d892b2a04a4586b9c59ad055182686'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:28.479129 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d892b2a04a4586b9c59ad055182686'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:28.494711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d892b2a04a4586b9c59ad055182686'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:28.495900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d892b2a04a4586b9c59ad055182686'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:28.503520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d892b2a04a4586b9c59ad055182686'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:28.510151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1193/2359] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:28 2022] DELETE /identity/v3/users/74d892b2a04a4586b9c59ad055182686 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:28.514862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:28.515424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:28.515545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:28.535946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:28.537138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:28.607118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1167/2360] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:28.617300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:28.619162 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:28.658784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:28.686527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950eaf-2f0c-40e9-b9b4-1998107eb5b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:28.690561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:28.691225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:28.691894 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:28.692177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:28.704952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:28.706512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:28.717249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1194/2361] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:29.046107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:29.047693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:29.060329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c93da-1042-4090-94cc-06f319fa9f0e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:29.065962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:29.069012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.069310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.069674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] PATH_INFO: `/v3/projects/876c00fbe130440b874e8c99cd971db3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.070953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876c00fbe130440b874e8c99cd971db3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:29.072970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:29.125722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876c00fbe130440b874e8c99cd971db3', 'request_id': 'req-7769cff2-8d7c-4d94-98ed-48b73029fc01'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.132209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876c00fbe130440b874e8c99cd971db3', 'request_id': 'req-7769cff2-8d7c-4d94-98ed-48b73029fc01'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.143485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876c00fbe130440b874e8c99cd971db3', 'request_id': 'req-7769cff2-8d7c-4d94-98ed-48b73029fc01'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.155247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] The token cache is being invalidate because project 876c00fbe130440b874e8c99cd971db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:29.155550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.156205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.157802 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1168/2362] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:29 2022] DELETE /identity/v3/projects/876c00fbe130440b874e8c99cd971db3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:29.163466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:29.174742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de827105-bcf3-4765-8e45-9cc3328ff199 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:29.236391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:29.237254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.237567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.237844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] PATH_INFO: `/v3/users/07127cf5aa764181a43f4dba5fbf5035` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.239052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07127cf5aa764181a43f4dba5fbf5035)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:29.241311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:29.306855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07127cf5aa764181a43f4dba5fbf5035'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.316299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07127cf5aa764181a43f4dba5fbf5035'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.329721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07127cf5aa764181a43f4dba5fbf5035'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.330434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07127cf5aa764181a43f4dba5fbf5035'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.338127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7ecded0f-8245-4797-8620-d67d86916df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07127cf5aa764181a43f4dba5fbf5035'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.345405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1195/2363] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:29 2022] DELETE /identity/v3/users/07127cf5aa764181a43f4dba5fbf5035 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:29.627523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:29.627523 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:29.635406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:29.642021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769cff2-8d7c-4d94-98ed-48b73029fc01 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:29.709256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:29.710137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.710417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.710692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] PATH_INFO: `/v3/projects/4007955cd52a45e485a87bf40667f033` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.711904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4007955cd52a45e485a87bf40667f033)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:29.713876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:29.761961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4007955cd52a45e485a87bf40667f033', 'request_id': 'req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.768900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4007955cd52a45e485a87bf40667f033', 'request_id': 'req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.778894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4007955cd52a45e485a87bf40667f033', 'request_id': 'req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.790086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] The token cache is being invalidate because project 4007955cd52a45e485a87bf40667f033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:29.790370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.791008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-47c71321-ba93-4fdb-9c41-6bcc64ce81cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:29.792586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1169/2364] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:29 2022] DELETE /identity/v3/projects/4007955cd52a45e485a87bf40667f033 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:29.798788 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.799094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.799410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.819824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:29.821066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:29.872933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:29.891588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1196/2365] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:29.902011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.902295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.902572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.922035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:29.923673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:29.932814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1170/2366] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:29.937815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:29.952941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a34645-3dcc-4586-83fb-3b3f49191b88 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:29.960309 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:29.960967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.961266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.961508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.962238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:29.962545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:29.964220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:29.977829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1197/2367] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:29.982389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:29.992267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a2ad-317b-41be-b188-62264a62af6e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:29.997282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:29.997938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:29.998221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:29.998482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:29.999195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.001137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.029223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1171/2368] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:29 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:30.036216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:30.046937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed93919-7b67-4534-a7fd-5eec171965ff admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:30.107899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:30.108584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.108871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.109152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.109828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.111844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.134274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1198/2369] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:30 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:30.138319 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:30.149101 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caea77-c1c0-49ef-be10-23c552d88c13 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:30.153779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:30.154804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.155088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.155392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.156124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.157744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.168498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1172/2370] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:30.173979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:30.187227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10e33a-432f-410c-bcb8-f225eb879aeb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:30.203085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:30.203933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.204298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.204658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.205552 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.207519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42982ed9-d687-4e46-8370-6b719470aa5d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.218929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1199/2371] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:30.223188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:30.234489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236f3-1f4d-48eb-82d6-581931ead712 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:30.240066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:30.240974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.241254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.241527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] PATH_INFO: `/v3/projects/7ec6604994f24954a14e36461b03de6b/users/d2dd48225f9543c2bf791a9f56c5bd88/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.258114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec6604994f24954a14e36461b03de6b, user_id=d2dd48225f9543c2bf791a9f56c5bd88, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.260875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.275751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1173/2372] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:30 2022] PUT /identity/v3/projects/7ec6604994f24954a14e36461b03de6b/users/d2dd48225f9543c2bf791a9f56c5bd88/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:30:30.287322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.287644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.287918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.315726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] MFA Rules not processed for user `d2dd48225f9543c2bf791a9f56c5bd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:30.316956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:30.386582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1200/2373] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:30.398311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:30.400133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:30.434805 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:30.461200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9d352-7a2a-4c0b-a61f-a2dbd4ddcc6e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:30.465225 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:30.465889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:30.466165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:30.466438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:30.475328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:30.476797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00e37-eb9c-41ed-b861-bd052f189110 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:30.486708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1174/2374] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:36.041256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:36.094033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:36.111594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4166c67-849b-48aa-8f8b-24bcd59a74fc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:36.116500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:36.117484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.117784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.118095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] PATH_INFO: `/v3/users/d2dd48225f9543c2bf791a9f56c5bd88` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.119343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2dd48225f9543c2bf791a9f56c5bd88)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:36.121315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:36.174148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2dd48225f9543c2bf791a9f56c5bd88'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.183322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2dd48225f9543c2bf791a9f56c5bd88'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.195966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2dd48225f9543c2bf791a9f56c5bd88'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.196700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2dd48225f9543c2bf791a9f56c5bd88'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.204202 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2dd48225f9543c2bf791a9f56c5bd88'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.210892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1201/2375] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:36 2022] DELETE /identity/v3/users/d2dd48225f9543c2bf791a9f56c5bd88 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:36.216668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.217155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.217249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.243746 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:36.244981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:36.315283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1175/2376] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:36.325147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:36.326690 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:36.386625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c2a3a-ea48-45d6-b23d-67935a8965ce admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:36.390640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:36.391319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.391609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.391878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.402736 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:36.404646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372a9f-5a3b-436d-8005-9f014046e47d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:36.415407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1202/2377] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:36.716580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:36.718169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:36.734031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670488-c3e0-46ed-b88e-6953512140e1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:36.740091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:36.740984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.741292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.741543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] PATH_INFO: `/v3/projects/7ec6604994f24954a14e36461b03de6b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.743071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec6604994f24954a14e36461b03de6b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:36.745068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:36.794435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec6604994f24954a14e36461b03de6b', 'request_id': 'req-33a64fe5-8f07-496b-a95d-6ad96f4c3364'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.801136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec6604994f24954a14e36461b03de6b', 'request_id': 'req-33a64fe5-8f07-496b-a95d-6ad96f4c3364'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.809522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec6604994f24954a14e36461b03de6b', 'request_id': 'req-33a64fe5-8f07-496b-a95d-6ad96f4c3364'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.820856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] The token cache is being invalidate because project 7ec6604994f24954a14e36461b03de6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:36.821073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.822314 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-33a64fe5-8f07-496b-a95d-6ad96f4c3364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:36.824063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1176/2378] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:36 2022] DELETE /identity/v3/projects/7ec6604994f24954a14e36461b03de6b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:36.831017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.831499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.831938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.853938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:36.855205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:36.921101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1203/2379] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:36.929227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.929486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.929760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.949302 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:36.950571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:36.960401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1177/2380] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:36.964999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:36.975350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54225fb2-7a24-43b4-836c-fa459df6e692 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:36.981794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:36.982444 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:36.982729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:36.983009 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:36.983800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:36.984113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:36.985762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:36.993572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:37.000555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1204/2381] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:37.005544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.021025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d43f5-4566-440f-81bf-349cd3243a79 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.028821 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.029851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.030127 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.030394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.031090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.033055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.062574 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1178/2382] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:37.066905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.078365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387fa8-71f6-42e2-9586-4608c4d1f7b2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.136375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.137080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.137359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.137639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.138341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.140355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.163250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1205/2383] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:37.168161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.182311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df947-8bb2-4ca5-ab77-586813184001 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.187146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.187869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.188148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.188422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.189163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.190819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.202868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1179/2384] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:37.207093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.217500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a04c5-dc03-4ac8-9e96-2b370bceb1b9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.222194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.222869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.223153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.223477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.224221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.225850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6bcb0-5521-4446-9354-333ba602a74b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.236238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1206/2385] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:37.240515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.256638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6c6b-a540-42b8-adbb-4b81f1b34111 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.265293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.266692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.266905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.267245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] PATH_INFO: `/v3/projects/f19a553bedb9440b96ebb3065bebd6a1/users/d3a8ecdbbfc049e1904fba211cd15fc8/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.284532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:37.289196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19a553bedb9440b96ebb3065bebd6a1, user_id=d3a8ecdbbfc049e1904fba211cd15fc8, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.292750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.308825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1180/2386] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:37 2022] PUT /identity/v3/projects/f19a553bedb9440b96ebb3065bebd6a1/users/d3a8ecdbbfc049e1904fba211cd15fc8/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:37.325139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.325139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.325139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.349671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] MFA Rules not processed for user `d3a8ecdbbfc049e1904fba211cd15fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:37.350967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:37.420727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1207/2387] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:37.425995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.505010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80943ec0-b214-4412-9633-acda9c5015f8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.511237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.512181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.512483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.512764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.513562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.515841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.547416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1181/2388] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:37.550773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.563581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec00b2c-6dcb-45fb-ba53-c00af59039da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.645145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.645855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.646269 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.646393 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.647111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.649226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.665306 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:37.684051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1208/2389] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:37.684357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.699806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8773b6-39f6-4e62-9566-5f885c0772e0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.706288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.707182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.707501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.707779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.708605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.710244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.727505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1182/2390] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:37.729856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.740143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba26f85-c597-4090-9bfd-7cc8e1369370 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.746249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.747174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.747494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.747774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] PATH_INFO: `/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29/users/b1cd0032029a4ca1b1a55eeea20eb9d3/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.767673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.768750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12a09c7ae20487cb45ffdfacfafdf29, user_id=b1cd0032029a4ca1b1a55eeea20eb9d3, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.769456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:37.771489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.786292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1209/2391] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:37 2022] PUT /identity/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29/users/b1cd0032029a4ca1b1a55eeea20eb9d3/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:37.790337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.834875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fc340-3b20-4eaa-a669-12c87d494648 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.856068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d024c-2b3f-4e93-8623-f04eb1dd10af admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.861670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.862354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.862632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.862901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.863782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.865944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.880274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1210/2392] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:37.883919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:37.887611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.888277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.888559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.888924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.890904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:37.894108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb8e73-a434-4ce6-a5a8-f051a1c3ec7e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:37.899474 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:37.900384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.900661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.900926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] PATH_INFO: `/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29/users/b1cd0032029a4ca1b1a55eeea20eb9d3/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.903123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12a09c7ae20487cb45ffdfacfafdf29, user_id=b1cd0032029a4ca1b1a55eeea20eb9d3, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.903580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:37.905527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0e8ba-0cec-4a65-ba9d-0b20b8844fdb service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.906254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:37.917382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1183/2393] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:30:37.920547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1211/2394] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:37 2022] PUT /identity/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29/users/b1cd0032029a4ca1b1a55eeea20eb9d3/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:37.930909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:37.931202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:37.931504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:37.958151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] MFA Rules not processed for user `b1cd0032029a4ca1b1a55eeea20eb9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:37.959592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:37.974367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.040318 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1184/2395] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:38.051719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:38.054082 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:38.116791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12833e9-17b3-445e-867c-0c0866ddb252 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:38.121665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:38.122418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:38.124155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:38.124155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:38.186017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:38.187522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464049fe-dda1-4b89-aebb-47d7ff3b69f8 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:38.197512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1212/2396] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:40.800822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:40.899266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2830-8c86-4d5f-b345-1112f6e29a4d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:40.911198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:40.912169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:40.912482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:40.912758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] PATH_INFO: `/v3/users/d3a8ecdbbfc049e1904fba211cd15fc8` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:40.914023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a8ecdbbfc049e1904fba211cd15fc8)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:40.916121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:41.008195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a8ecdbbfc049e1904fba211cd15fc8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.018795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a8ecdbbfc049e1904fba211cd15fc8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.035099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a8ecdbbfc049e1904fba211cd15fc8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.035982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a8ecdbbfc049e1904fba211cd15fc8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.036690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a8ecdbbfc049e1904fba211cd15fc8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.068891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1185/2397] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:40 2022] DELETE /identity/v3/users/d3a8ecdbbfc049e1904fba211cd15fc8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:41.070976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:41.071512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:41.072417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:41.097392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:41.098642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:41.104295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:41.209568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1213/2398] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:41.228675 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:41.230894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:41.312084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:41.371958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357ad3-4aa9-4c66-895d-aa51ca5f58ea admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:41.376741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:41.378077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:41.378077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:41.378077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:41.391047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:41.392553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:41.406658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1186/2399] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:41.633116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:41.635429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:41.658469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9b124-d4cd-4938-bb35-48ba9ab13282 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:41.667452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:41.668778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:41.669460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:41.672696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] PATH_INFO: `/v3/users/048ff38a084747338fb6d69ed0ab9644` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:41.678338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048ff38a084747338fb6d69ed0ab9644)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:41.680758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:41.751543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048ff38a084747338fb6d69ed0ab9644'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.763180 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048ff38a084747338fb6d69ed0ab9644'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.782175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048ff38a084747338fb6d69ed0ab9644'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.782949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048ff38a084747338fb6d69ed0ab9644'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.795899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048ff38a084747338fb6d69ed0ab9644'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:41.805401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1214/2400] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:41 2022] DELETE /identity/v3/users/048ff38a084747338fb6d69ed0ab9644 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:41.820442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:41.822759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:41.854481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64eb9-0963-4b30-905f-e54be59b0d71 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:41.962128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:41.963007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:41.963283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:41.963729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] PATH_INFO: `/v3/projects/f19a553bedb9440b96ebb3065bebd6a1` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:41.965154 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19a553bedb9440b96ebb3065bebd6a1)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:41.967130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.028666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19a553bedb9440b96ebb3065bebd6a1', 'request_id': 'req-421b95b3-89ad-4f91-ac34-2a659e02c95c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.035326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.036926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.037194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19a553bedb9440b96ebb3065bebd6a1', 'request_id': 'req-421b95b3-89ad-4f91-ac34-2a659e02c95c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.051282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19a553bedb9440b96ebb3065bebd6a1', 'request_id': 'req-421b95b3-89ad-4f91-ac34-2a659e02c95c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.062364 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361da3-1379-418f-9257-4d1770d87d06 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.065564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] The token cache is being invalidate because project f19a553bedb9440b96ebb3065bebd6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:42.066035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.067066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.068810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1187/2401] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:41 2022] DELETE /identity/v3/projects/f19a553bedb9440b96ebb3065bebd6a1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:42.073011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.074401 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.138085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.139133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.139524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.139915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] PATH_INFO: `/v3/projects/35a21c3a1a9145c8a34989448a263bde` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.141219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a21c3a1a9145c8a34989448a263bde)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.143256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.149645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b95b3-89ad-4f91-ac34-2a659e02c95c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.155855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.156965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.157571 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.158004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] PATH_INFO: `/v3/users/b1cd0032029a4ca1b1a55eeea20eb9d3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.159520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cd0032029a4ca1b1a55eeea20eb9d3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.162083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.165606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:42.173095 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:42.203207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a21c3a1a9145c8a34989448a263bde', 'request_id': 'req-cd470e77-bd92-45e3-bf04-9addd793b366'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.212577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a21c3a1a9145c8a34989448a263bde', 'request_id': 'req-cd470e77-bd92-45e3-bf04-9addd793b366'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.220509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a21c3a1a9145c8a34989448a263bde', 'request_id': 'req-cd470e77-bd92-45e3-bf04-9addd793b366'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.226949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cd0032029a4ca1b1a55eeea20eb9d3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.234779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cd0032029a4ca1b1a55eeea20eb9d3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.234977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] The token cache is being invalidate because project 35a21c3a1a9145c8a34989448a263bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:42.235266 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.235958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cd470e77-bd92-45e3-bf04-9addd793b366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.237674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1215/2402] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:42 2022] DELETE /identity/v3/projects/35a21c3a1a9145c8a34989448a263bde => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:42.243055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.243366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.243712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.246074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cd0032029a4ca1b1a55eeea20eb9d3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.246966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cd0032029a4ca1b1a55eeea20eb9d3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.247816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0a65269b-a022-48f7-9ce4-2bd038f5f5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cd0032029a4ca1b1a55eeea20eb9d3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.264674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:42.265913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.271739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1188/2403] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:42 2022] DELETE /identity/v3/users/b1cd0032029a4ca1b1a55eeea20eb9d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:42.339585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1216/2404] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:42.348591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.349195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.349575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.370898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:42.372489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.457072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1189/2405] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:42.462068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.475835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12abe-d8aa-40d5-ac0a-c31a0d57ebdd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.481253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.481940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.482224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.482502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.483248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:42.483610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.487104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.502512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1217/2406] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:42.507645 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.519926 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19582b2-1dc9-4a99-8f30-960b69de2325 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.526402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.526708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.526991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.527259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.527998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.530329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.564951 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1190/2407] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:42.569325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.584952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186cd66-be40-4696-bacc-24dcf70b57fc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.606104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.608276 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.680748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.681460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.681739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.682012 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.682725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.684730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.707939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb5af-7243-417f-b66c-571c1fde80d6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.712727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1218/2408] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:42.714077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.714966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.715243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.715552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] PATH_INFO: `/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.716778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12a09c7ae20487cb45ffdfacfafdf29)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.717243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.718728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.720799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:42.728799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b607f1-5524-4583-bd87-87ad4dc43275 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.735560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.736391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.736916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.737058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.737937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.739705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.752078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1219/2409] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:42.756533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.771519 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3006e9-9e05-4cbe-8f19-b4b3dc0014e3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.786492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:42.787671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12a09c7ae20487cb45ffdfacfafdf29', 'request_id': 'req-8db82089-17da-4c57-81e0-4582381ccfe3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.798515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12a09c7ae20487cb45ffdfacfafdf29', 'request_id': 'req-8db82089-17da-4c57-81e0-4582381ccfe3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.809936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12a09c7ae20487cb45ffdfacfafdf29', 'request_id': 'req-8db82089-17da-4c57-81e0-4582381ccfe3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.824115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] The token cache is being invalidate because project e12a09c7ae20487cb45ffdfacfafdf29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:42.824733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.825326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8db82089-17da-4c57-81e0-4582381ccfe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:42.826957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1191/2410] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:42 2022] DELETE /identity/v3/projects/e12a09c7ae20487cb45ffdfacfafdf29 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:42.831774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca9ad-8536-43c8-be90-eb4a527fbd95 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.832296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca9ad-8536-43c8-be90-eb4a527fbd95 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.832745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca9ad-8536-43c8-be90-eb4a527fbd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.846571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.847405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.847748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.848081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.848844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.850505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.852507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-834ca9ad-8536-43c8-be90-eb4a527fbd95 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:42.854174 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-834ca9ad-8536-43c8-be90-eb4a527fbd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.865517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1220/2411] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:42.865736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1192/2412] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:42.870540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.871456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.871752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.872089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.872338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.885104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0cbff-402b-40f4-bfdb-6561b0ffbb44 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.890610 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.891671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.892055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.892405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:42.892532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] PATH_INFO: `/v3/projects/59b753f81aae4f4f86ae6f10573ea813/users/958ba8bc1d994ce488f5e101f30b160e/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.893745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:42.902709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1193/2413] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:42.907297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.911081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b753f81aae4f4f86ae6f10573ea813, user_id=958ba8bc1d994ce488f5e101f30b160e, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.913937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd87ed-b258-40d1-9227-fd4c4b77c7c1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.917827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f33300-9d49-41ec-b51b-ec6f0c7bb7eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.924592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:42.925691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.926029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.926692 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.927818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:42.928538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:42.930830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:42.931247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1221/2414] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:42 2022] PUT /identity/v3/projects/59b753f81aae4f4f86ae6f10573ea813/users/958ba8bc1d994ce488f5e101f30b160e/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:42.943798 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:42.944163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:42.944539 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:42.949841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1194/2415] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:42.956290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:42.968711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c031f0-47c5-40ba-b822-5c1deb891084 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:42.980763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] MFA Rules not processed for user `958ba8bc1d994ce488f5e101f30b160e`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:42.983144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:43.060725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.061871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.062338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.062747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.063857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.067179 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.076919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1222/2416] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:43.094591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.096446 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:43.109338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1195/2417] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:42 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:43.113373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.186452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:43.193251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92646-cb62-4b6b-93b2-a89146d0e31b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.201562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebead0f-a273-4999-ace0-658ed9c41b43 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.208724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.209200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:43.209532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.210076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.210411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.211593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.213848 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.237398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1196/2418] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:43 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:30:43.242256 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.257159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6499-d50c-4c9e-a5be-6a09060dbc65 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.263121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.263935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.264363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.264804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.265635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.267407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.271138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.271836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.272116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.272398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.282210 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1197/2419] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:43.283781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.294818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4860a-f39d-43a6-8189-01f62c94358c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.300425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.301232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.301585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.301922 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.302727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.304458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.319924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1198/2420] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:43.324224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.334085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.334731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d8d2-9308-4d8d-9606-f37ff27cbdff admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.335688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0768e-083f-4308-b10f-262a43c12b6e service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.340108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.341120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.341495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.341859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] PATH_INFO: `/v3/projects/8cc7273a171847b1961f0e8557649b80/users/8a89c11a8239436d93c2d528afb42622/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.350089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1223/2421] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:43.358928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc7273a171847b1961f0e8557649b80, user_id=8a89c11a8239436d93c2d528afb42622, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.361698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.380903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1199/2422] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:43 2022] PUT /identity/v3/projects/8cc7273a171847b1961f0e8557649b80/users/8a89c11a8239436d93c2d528afb42622/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:30:43.383005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4532-4a8d-4757-a197-33dc04a690e7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.383585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4532-4a8d-4757-a197-33dc04a690e7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.383956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4532-4a8d-4757-a197-33dc04a690e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.408685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99ed4532-4a8d-4757-a197-33dc04a690e7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:43.410168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99ed4532-4a8d-4757-a197-33dc04a690e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:43.494951 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1224/2423] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:43.504459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:43.506633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:43.583995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c545-d761-408c-961f-d896cb0232d9 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:43.588774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:43.589508 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:43.589794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:43.590072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:43.604545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:43.606250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:43.625974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1200/2424] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:44.406466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fee01-d24b-4223-8c1c-9ee70729c87b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:44.407019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fee01-d24b-4223-8c1c-9ee70729c87b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:44.407841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fee01-d24b-4223-8c1c-9ee70729c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:44.442757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb3fee01-d24b-4223-8c1c-9ee70729c87b None None] MFA Rules not processed for user `8a89c11a8239436d93c2d528afb42622`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:44.444067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb3fee01-d24b-4223-8c1c-9ee70729c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:44.501837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:44.528995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1225/2425] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:44.543547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:44.545438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:44.615389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d849a9-e63d-4339-9383-51946d06c702 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:44.619625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:44.620911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:44.621206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:44.621483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:44.632152 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:44.633934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:44.644975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1201/2426] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:46.041041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f35aa-8041-4d7a-a0f3-3be04da7420b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:46.041591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f35aa-8041-4d7a-a0f3-3be04da7420b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:46.041591 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f35aa-8041-4d7a-a0f3-3be04da7420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:46.064390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3a8f35aa-8041-4d7a-a0f3-3be04da7420b None None] MFA Rules not processed for user `8a89c11a8239436d93c2d528afb42622`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:46.066846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3a8f35aa-8041-4d7a-a0f3-3be04da7420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:46.079593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1226/2427] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:48.777741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:48.797993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834d09f-b9e6-4305-8b4f-971a5691a5c5 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:48.803569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:48.804810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:48.805176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:48.805559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] PATH_INFO: `/v3/users/958ba8bc1d994ce488f5e101f30b160e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:48.807026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=958ba8bc1d994ce488f5e101f30b160e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:48.809945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:48.858768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:48.879839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958ba8bc1d994ce488f5e101f30b160e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:48.893194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958ba8bc1d994ce488f5e101f30b160e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:48.913178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958ba8bc1d994ce488f5e101f30b160e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:48.914051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958ba8bc1d994ce488f5e101f30b160e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:48.914936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958ba8bc1d994ce488f5e101f30b160e'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:48.941391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1202/2428] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:48 2022] DELETE /identity/v3/users/958ba8bc1d994ce488f5e101f30b160e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:48.946181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:48.946698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:48.950158 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:49.018120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:49.020644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:49.115891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1227/2429] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:49.142686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:49.145559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:49.246905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73f17-ca95-4fc0-8950-d59667dbf1bb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:49.250780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:49.251609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:49.252014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:49.252419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:49.263128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:49.264793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb8229-23e5-4d2b-bf7e-288883482cab service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:49.275901 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1203/2430] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:49.571042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:49.573641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:49.598648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3907d32-836c-47f4-87ec-3e3b2d173bcb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:49.605834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:49.607198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:49.607572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:49.607950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] PATH_INFO: `/v3/projects/59b753f81aae4f4f86ae6f10573ea813` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:49.609557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b753f81aae4f4f86ae6f10573ea813)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:49.611946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:49.703013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b753f81aae4f4f86ae6f10573ea813', 'request_id': 'req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:49.717611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b753f81aae4f4f86ae6f10573ea813', 'request_id': 'req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:49.728626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b753f81aae4f4f86ae6f10573ea813', 'request_id': 'req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:49.757903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] The token cache is being invalidate because project 59b753f81aae4f4f86ae6f10573ea813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:49.758498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:49.760166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aecd63ab-bee6-4d45-a4d7-d5a7e3daa482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:49.761546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1228/2431] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:49 2022] DELETE /identity/v3/projects/59b753f81aae4f4f86ae6f10573ea813 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:49.772481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:49.772767 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:49.773043 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:49.804892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:49.806999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:49.913781 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1204/2432] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:49.921797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:49.922212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:49.922573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:49.952966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:49.955840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:49.977997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1229/2433] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:49.982335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.009473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e00b14-b2f8-43ca-9337-3b3ed11838fd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.031648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.032617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.032914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.033183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.033931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:50.034231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.035900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.063399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1205/2434] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:50.065070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.081206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581afc-ca22-4d66-9b3c-770bd4f46f5b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.090899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.091692 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.092172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.092596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.093461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.095593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.145420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1230/2435] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:50 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:50.150012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.161162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fa890-4f0b-4ae4-a08e-b3a6c08096fb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.205561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:50.280435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.283880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.284999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.285471 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.287379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.292022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.328527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1206/2436] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:50 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:50.333458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.349917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f786e-ffc0-44b7-8c76-c922a187ef43 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.358085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.359396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.359888 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.360386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.361741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.365069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.387161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1231/2437] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:50.391292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.403433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250ae9-82a3-400d-b518-bbdf3750371d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.410248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.411031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.411426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.412108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.419964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.422231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319cb15-7d4b-44d2-9d89-33bf30b5a1f0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.434133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1207/2438] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:50.438508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.450837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbc1d8-ed98-48b6-be9a-675c071e1ff4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.455639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.456621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.456963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.457359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] PATH_INFO: `/v3/projects/f06ac70126674d61b01d4ac847bfaf7c/users/7187039c2350454e967df4d71dde7490/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.477078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06ac70126674d61b01d4ac847bfaf7c, user_id=7187039c2350454e967df4d71dde7490, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.480434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.492958 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:50.500464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1232/2439] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:50 2022] PUT /identity/v3/projects/f06ac70126674d61b01d4ac847bfaf7c/users/7187039c2350454e967df4d71dde7490/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:50.512538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.512829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.513108 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.544490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] MFA Rules not processed for user `7187039c2350454e967df4d71dde7490`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:50.545731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:50.612037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1208/2440] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:50.625109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:50.627114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:50.712156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d6a6-9cc0-467f-a459-48292738db5f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:50.719135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:50.719836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:50.720118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:50.720394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:50.729794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:50.731522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad81944-95d9-4349-9e53-81a0d5e0145d service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:50.740918 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1233/2441] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:53.475545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:53.554129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6efb-a655-4e48-889d-54b1849eaf3a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:53.558865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:53.559786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:53.560067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:53.560371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] PATH_INFO: `/v3/users/7187039c2350454e967df4d71dde7490` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:53.561547 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7187039c2350454e967df4d71dde7490)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:53.563927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:53.629313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7187039c2350454e967df4d71dde7490'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:53.632358 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:53.647348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7187039c2350454e967df4d71dde7490'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:53.668278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7187039c2350454e967df4d71dde7490'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:53.669350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7187039c2350454e967df4d71dde7490'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:53.670541 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-743487cd-d17f-4bcd-baba-9631aa2d4de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7187039c2350454e967df4d71dde7490'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:53.673733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:53.674201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:53.674455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:53.695175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1209/2442] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:53 2022] DELETE /identity/v3/users/7187039c2350454e967df4d71dde7490 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:53.696767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:53.698634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:53.700559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:53.700921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:53.701317 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:53.722988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:53.724445 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:53.763846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1234/2443] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:53.802432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1210/2444] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:53.824477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:53.825792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:53.827907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:53.830241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:53.912392 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2c8a-7a1c-4c8f-b1db-46baa4bc6198 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:53.921003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:53.921703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:53.922640 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:53.922924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:53.938923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:53.942323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:53.946061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2115c-e783-40ff-8ef7-f1a7216abfbc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:53.953398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:53.954345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:53.954855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:53.955391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1235/2445] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:53.955823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:53.967955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:53.969671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:53.980495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1211/2446] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:30:53.998946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:54.001299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:54.142582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:54.219948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb5a-bea3-4595-81ac-8a94bcc51cf6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:54.227048 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:54.227952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.228321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.228694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.230629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:54.247337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:54.249146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe4f1-0227-408a-8972-974b734a5818 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:54.281733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1236/2447] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:54.370224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:54.371883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:54.405709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b500d45-6ec3-479e-8730-549172feb78e service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:54.414564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:54.415799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.416021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.416292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] PATH_INFO: `/v3/projects/f06ac70126674d61b01d4ac847bfaf7c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.417596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06ac70126674d61b01d4ac847bfaf7c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:54.419681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:54.497296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06ac70126674d61b01d4ac847bfaf7c', 'request_id': 'req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:54.499592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:54.505582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06ac70126674d61b01d4ac847bfaf7c', 'request_id': 'req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:54.518066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06ac70126674d61b01d4ac847bfaf7c', 'request_id': 'req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:54.541880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] The token cache is being invalidate because project f06ac70126674d61b01d4ac847bfaf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:54.542513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:54.543578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ddc9f876-ff50-4d12-b15c-668bf7b0e99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:54.545776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1212/2448] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:54 2022] DELETE /identity/v3/projects/f06ac70126674d61b01d4ac847bfaf7c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:54.550801 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.551086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.551390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.572566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:54.574123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:54.660866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1237/2449] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:30:54.669171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.669414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.669651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.690617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:54.692494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:54.704142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1213/2450] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:54.708484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:54.720349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c2e3-efe6-4638-b0f5-f3d33d549b55 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:54.728967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:54.730745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.731581 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.732100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.733447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:54.734067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:54.735864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:54.754066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1238/2451] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:30:54.758172 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:54.785896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38aadf-6004-44eb-82e2-a0892f013ca0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:54.792123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:54.792930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.793311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.793683 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.795097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:54.796585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:54.845517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1214/2452] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:54 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:54.847961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:54.863168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa53d9-2832-4509-823f-d3979be74ac5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:54.967504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:54.968207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:54.968501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:54.968770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:54.969621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:54.971611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:54.998965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1239/2453] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:54 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:55.000769 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.015799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c110-53ca-4d25-9a36-61ccbefdca90 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.021349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.022033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.022322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.022594 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.023346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.025107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.041087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1215/2454] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:55.042387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.056000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2f801-b57f-4999-b8c2-7d6da9676e5a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.062347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.063044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.063342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.063645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.064383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.066145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7d35-ec05-4958-9fc5-0b4c59515edc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.080156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1240/2455] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:55.084729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.100985 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f76b-fa8b-4976-a7d6-90086edba81a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.106135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.107117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.107548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.107867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] PATH_INFO: `/v3/projects/2223c1074ec34626906b506ad9ed401c/users/57b74eb9e34f4e0c85f1dafd2669485d/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.130611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2223c1074ec34626906b506ad9ed401c, user_id=57b74eb9e34f4e0c85f1dafd2669485d, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.133322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.163247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.163579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.163859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.179595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1216/2456] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:55 2022] PUT /identity/v3/projects/2223c1074ec34626906b506ad9ed401c/users/57b74eb9e34f4e0c85f1dafd2669485d/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:55.217604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] MFA Rules not processed for user `57b74eb9e34f4e0c85f1dafd2669485d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:55.220267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:55.236165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:55.351354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1241/2457] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:55.357647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.454495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d60c2a-6121-40b0-8efc-011f009494f6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.462537 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.463275 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.463730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.464008 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.464760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.466718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.503589 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1217/2458] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:55 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:55.504559 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.516622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4030c5-6fe9-4076-8af2-ff515084eb82 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.587113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.588179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.588538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.588882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.589684 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.592118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.615419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1242/2459] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:55 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:30:55.620211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.634400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7711-54a4-4aa7-8cc7-e6ad7b64b426 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.641473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.647145 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.647587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.647929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.648778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.650742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.664177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1218/2460] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:55.670613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.694562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b2247-cba5-40f1-a583-6cd340ce0e70 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.708518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.711287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.712648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.713247 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] PATH_INFO: `/v3/projects/a71a7ca6002144608052e28a068ffe0d/users/9f215d0119854ddd8a099e401040a463/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.736761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7ca6002144608052e28a068ffe0d, user_id=9f215d0119854ddd8a099e401040a463, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.740358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.765670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1243/2461] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:55 2022] PUT /identity/v3/projects/a71a7ca6002144608052e28a068ffe0d/users/9f215d0119854ddd8a099e401040a463/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:55.766874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.782083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c9e1-fb59-4054-a472-d05fa22e130f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.874968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:55.891899 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.892771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.893055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.893363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.894618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.896479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5478a62-91e4-422d-bb68-207248282928 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.911555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1219/2462] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:55.912738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:55.931524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7252a-207c-459c-ab20-4746a8d452f7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:55.939588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:55.942023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.943045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.943876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] PATH_INFO: `/v3/projects/a71a7ca6002144608052e28a068ffe0d/users/9f215d0119854ddd8a099e401040a463/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:55.946794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71a7ca6002144608052e28a068ffe0d, user_id=9f215d0119854ddd8a099e401040a463, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:55.950362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:55.962742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1244/2463] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:55 2022] PUT /identity/v3/projects/a71a7ca6002144608052e28a068ffe0d/users/9f215d0119854ddd8a099e401040a463/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:55.978007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:55.978297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:55.978566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:56.025016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] MFA Rules not processed for user `9f215d0119854ddd8a099e401040a463`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:56.027158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:56.128770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1220/2464] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:56.141255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:56.143042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:56.223020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825d98-14e9-4b84-a79e-f60219d90a77 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:56.227804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:56.228717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:56.228993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:56.229394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:56.240086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:56.241705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cfce9-5d7d-4718-8e40-1f688a00ce4f service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:56.253555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1245/2465] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:56.328409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:56.435195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a9785-1521-4bd5-b4eb-0e422ea9b04b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:56.443034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:56.444073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:56.444416 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:56.446009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] PATH_INFO: `/v3/users/57b74eb9e34f4e0c85f1dafd2669485d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:56.447525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b74eb9e34f4e0c85f1dafd2669485d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:56.450586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:56.530685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b74eb9e34f4e0c85f1dafd2669485d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:56.540354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b74eb9e34f4e0c85f1dafd2669485d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:56.552156 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b74eb9e34f4e0c85f1dafd2669485d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:56.553126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b74eb9e34f4e0c85f1dafd2669485d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:56.553959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b74eb9e34f4e0c85f1dafd2669485d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:56.565191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:56.583504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1221/2466] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:56 2022] DELETE /identity/v3/users/57b74eb9e34f4e0c85f1dafd2669485d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:56.590538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:56.590869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:56.591249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:56.607688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:56.616988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:56.619342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:56.712614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1246/2467] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:56.719693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:56.721338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:56.809271 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68efc-763b-401c-a086-841567f41413 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:56.818461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:56.819924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:56.820368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:56.820896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:56.837991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:56.840021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:56.852136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1222/2468] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:57.205345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:57.207045 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:57.227065 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015dd7-ff8d-4e3d-aa48-8fe72bd927b7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:57.232532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:57.233698 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:57.234126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:57.234564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] PATH_INFO: `/v3/projects/2223c1074ec34626906b506ad9ed401c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:57.236265 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2223c1074ec34626906b506ad9ed401c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:57.238388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:57.311713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2223c1074ec34626906b506ad9ed401c', 'request_id': 'req-21827fc3-4d38-4652-98a3-86318932e893'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.323636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2223c1074ec34626906b506ad9ed401c', 'request_id': 'req-21827fc3-4d38-4652-98a3-86318932e893'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.332809 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2223c1074ec34626906b506ad9ed401c', 'request_id': 'req-21827fc3-4d38-4652-98a3-86318932e893'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.349756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] The token cache is being invalidate because project 2223c1074ec34626906b506ad9ed401c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:57.350584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.351553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.353489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1247/2469] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:57 2022] DELETE /identity/v3/projects/2223c1074ec34626906b506ad9ed401c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:57.357393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:57.370892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a775af-6831-424e-87da-170f59ba6a3e service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:57.444702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:57.445738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:57.446080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:57.446385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] PATH_INFO: `/v3/users/9f215d0119854ddd8a099e401040a463` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:57.447766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f215d0119854ddd8a099e401040a463)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:57.449887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:57.508429 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f215d0119854ddd8a099e401040a463'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.517618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f215d0119854ddd8a099e401040a463'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.528055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f215d0119854ddd8a099e401040a463'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.528763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f215d0119854ddd8a099e401040a463'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.529766 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-fad5472e-ffe8-4edb-b5bd-6a856aae2c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f215d0119854ddd8a099e401040a463'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:57.551815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1223/2470] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:30:57 2022] DELETE /identity/v3/users/9f215d0119854ddd8a099e401040a463 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:58.006437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.008084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:58.022557 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc3-4d38-4652-98a3-86318932e893 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.102374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.104241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.105611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.111796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] PATH_INFO: `/v3/projects/a71a7ca6002144608052e28a068ffe0d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.113720 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71a7ca6002144608052e28a068ffe0d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.115852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.161122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:58.176423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71a7ca6002144608052e28a068ffe0d', 'request_id': 'req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:58.189477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71a7ca6002144608052e28a068ffe0d', 'request_id': 'req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:58.200274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71a7ca6002144608052e28a068ffe0d', 'request_id': 'req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:58.220097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] The token cache is being invalidate because project a71a7ca6002144608052e28a068ffe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:30:58.220097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:58.221252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b3f585d3-f4d9-4bc9-8a98-20b05626c39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:30:58.223230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1248/2471] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:30:58 2022] DELETE /identity/v3/projects/a71a7ca6002144608052e28a068ffe0d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:58.228904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.229359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.229750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.253546 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:58.255294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:58.270340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:58.335181 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1224/2472] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:58.343047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.343352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.343641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.376796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:58.378047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:58.406846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1249/2473] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:58.412161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.425270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31b2b-a89d-4302-ab3e-29b487245434 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.433476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.434066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.434348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.434621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.435406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:30:58.435715 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.437871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.461092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.467595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1225/2474] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:30:58.472980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4bfd-6780-4b9c-a1fa-ea5a2c8dfc08 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.480029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.480727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.481107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.481386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.482153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.484646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.571883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1250/2475] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:58 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:30:58.576102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.594904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374d9e2-421d-4cf1-9cf7-a6b1fab00eb8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.743006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.743861 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.744220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.744378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.745083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.748169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.778219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1226/2476] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:58 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:58.782532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.794076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff829ea-1b68-4dc6-971f-f78850e1ddcd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.802380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.803811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.804909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.805305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.806227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.808020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.820394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1251/2477] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:58.824758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.836999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94094-d00e-4730-aac0-58fc8709d710 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.843851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.845105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.845483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.845855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.847077 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.848800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdad57d-faff-4ffe-8881-83819418fc62 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.861194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1227/2478] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:30:58.865641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:58.878967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3d42-7d22-4bbc-bcb3-3637882226ab admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:58.884252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:58.885182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.885466 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.885744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] PATH_INFO: `/v3/projects/2b4665c6e3b7496aac937d35e5cf62f7/users/359f01cadc6d4643b7424f07ac97737e/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:58.920016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4665c6e3b7496aac937d35e5cf62f7, user_id=359f01cadc6d4643b7424f07ac97737e, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:58.924987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:58.974554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1252/2479] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:58 2022] PUT /identity/v3/projects/2b4665c6e3b7496aac937d35e5cf62f7/users/359f01cadc6d4643b7424f07ac97737e/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:58.977757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:58.978389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:58.978888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.037806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] MFA Rules not processed for user `359f01cadc6d4643b7424f07ac97737e`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:59.039458 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:59.145749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1228/2480] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:59.150848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.232454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c8d02-c414-4e03-991e-d5ecc5b2ac84 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.237786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.238592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.238877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.239153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.239935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.241879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.274599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1253/2481] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:30:59 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:59.279430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.291727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6667912-b895-492f-bd93-bd4009ee4e3b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.296881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:59.358197 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.358887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.359168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.359475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.360180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.362124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.388106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1229/2482] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:30:59 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:30:59.392130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.407936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303eeb2-b337-421c-a215-314e2a65d9aa admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.414593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.415456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.415828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.416165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.416975 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.418787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.435994 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1254/2483] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:59.437346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.451814 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b036e-5c6b-45dc-a82a-a180bf856b1b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.458218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.459231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.459863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.459966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] PATH_INFO: `/v3/projects/df83dc8408844119ab5fb87942ecfa95/users/d729a7c27d444de3b5145e84986272d8/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.479659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df83dc8408844119ab5fb87942ecfa95, user_id=d729a7c27d444de3b5145e84986272d8, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.482538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.502053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1230/2484] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:59 2022] PUT /identity/v3/projects/df83dc8408844119ab5fb87942ecfa95/users/d729a7c27d444de3b5145e84986272d8/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:59.503418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.514313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065f6a8-35d9-4dda-afd5-d564a209297a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.549261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:59.582205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.583130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.583464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.583741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.584492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.586278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b4c67-abd0-4790-9dbb-8b5dc738aa26 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.600831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1255/2485] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:30:59.602372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.613553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eef71-66e6-4e53-8085-f6bc91c6be36 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.625923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.625923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.625923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.625923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] PATH_INFO: `/v3/projects/df83dc8408844119ab5fb87942ecfa95/users/d729a7c27d444de3b5145e84986272d8/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.628139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df83dc8408844119ab5fb87942ecfa95, user_id=d729a7c27d444de3b5145e84986272d8, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.631039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.651171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1231/2486] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:30:59 2022] PUT /identity/v3/projects/df83dc8408844119ab5fb87942ecfa95/users/d729a7c27d444de3b5145e84986272d8/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:30:59.664883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.665165 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.665443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.701455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] MFA Rules not processed for user `d729a7c27d444de3b5145e84986272d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:59.703091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:59.791341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1256/2487] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:30:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:59.798554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:59.800839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:59.887220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a6018-7260-449d-b819-ff21d9eb951c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:59.891214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:59.891998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:59.892350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:59.892853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:59.905974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:59.907611 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd88ae-cd26-42c2-8907-000a840dc9dc service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:59.926470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1232/2488] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:00.772742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:00.870111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0db6a2-2e27-45ea-8145-f31dd744dce3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:00.886695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:00.887648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:00.887912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:00.888184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] PATH_INFO: `/v3/users/359f01cadc6d4643b7424f07ac97737e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:00.889897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] RBAC: Authorizing `identity:delete_user(user_id=359f01cadc6d4643b7424f07ac97737e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:00.891896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:00.958632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359f01cadc6d4643b7424f07ac97737e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:00.970472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359f01cadc6d4643b7424f07ac97737e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:00.972645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:00.989069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359f01cadc6d4643b7424f07ac97737e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:00.990074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359f01cadc6d4643b7424f07ac97737e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.000276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359f01cadc6d4643b7424f07ac97737e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.007786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1257/2489] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:00 2022] DELETE /identity/v3/users/359f01cadc6d4643b7424f07ac97737e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:01.012255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:01.012782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:01.012982 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:01.033455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:01.034829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:01.113030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1233/2490] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:01.125540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:01.127053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:01.202886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde9fe-98cd-4edf-a933-b76f92d6efff admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:01.206802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:01.207563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:01.207925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:01.208260 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:01.219224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:01.221534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:01.233311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1258/2491] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:01.608678 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:01.610255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:01.620031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:01.641020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09f4f-973b-463a-9487-eb1e5ebfd6b7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:01.662798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:01.664124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:01.664556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:01.664956 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] PATH_INFO: `/v3/projects/2b4665c6e3b7496aac937d35e5cf62f7` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:01.666550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4665c6e3b7496aac937d35e5cf62f7)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:01.669515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:01.726009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4665c6e3b7496aac937d35e5cf62f7', 'request_id': 'req-03b19577-ff2d-4f61-b24d-1f7912dfb156'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.733771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4665c6e3b7496aac937d35e5cf62f7', 'request_id': 'req-03b19577-ff2d-4f61-b24d-1f7912dfb156'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.744310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4665c6e3b7496aac937d35e5cf62f7', 'request_id': 'req-03b19577-ff2d-4f61-b24d-1f7912dfb156'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.756555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] The token cache is being invalidate because project 2b4665c6e3b7496aac937d35e5cf62f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:01.756893 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.757485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.759558 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1234/2492] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:01 2022] DELETE /identity/v3/projects/2b4665c6e3b7496aac937d35e5cf62f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:31:01.763704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:01.775561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897407-ce2b-4056-bcac-eabde5666de2 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:01.844072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:01.845420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:01.845896 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:01.846395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] PATH_INFO: `/v3/users/d729a7c27d444de3b5145e84986272d8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:01.847656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d729a7c27d444de3b5145e84986272d8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:01.849631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:01.911153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd729a7c27d444de3b5145e84986272d8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.921007 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd729a7c27d444de3b5145e84986272d8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.938524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd729a7c27d444de3b5145e84986272d8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.939459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd729a7c27d444de3b5145e84986272d8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.957729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:01.964054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c84c1a1-ae35-4ab2-a8f7-0b9c969c3012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd729a7c27d444de3b5145e84986272d8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:01.993675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1259/2493] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:01 2022] DELETE /identity/v3/users/d729a7c27d444de3b5145e84986272d8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:02.359729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:02.362013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:02.376637 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19577-ff2d-4f61-b24d-1f7912dfb156 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:02.465324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:02.466600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:02.467031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:02.467490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] PATH_INFO: `/v3/projects/df83dc8408844119ab5fb87942ecfa95` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:02.468912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df83dc8408844119ab5fb87942ecfa95)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:02.471016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:02.537648 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df83dc8408844119ab5fb87942ecfa95', 'request_id': 'req-7fe47629-cf85-4e17-8c5d-523d7bef92e4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:02.548891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df83dc8408844119ab5fb87942ecfa95', 'request_id': 'req-7fe47629-cf85-4e17-8c5d-523d7bef92e4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:02.564722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df83dc8408844119ab5fb87942ecfa95', 'request_id': 'req-7fe47629-cf85-4e17-8c5d-523d7bef92e4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:02.577623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] The token cache is being invalidate because project df83dc8408844119ab5fb87942ecfa95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:02.579629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:02.582324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7fe47629-cf85-4e17-8c5d-523d7bef92e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:02.583760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1235/2494] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:02 2022] DELETE /identity/v3/projects/df83dc8408844119ab5fb87942ecfa95 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:02.588828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826508-2d3c-4537-9450-d525969156b5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:02.589255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826508-2d3c-4537-9450-d525969156b5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:02.589658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826508-2d3c-4537-9450-d525969156b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:02.612873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-74826508-2d3c-4537-9450-d525969156b5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:02.614224 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-74826508-2d3c-4537-9450-d525969156b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:02.707140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1260/2495] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:02.714728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:02.715141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:02.715871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:02.748891 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:02.750431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:02.777532 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1236/2496] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:02.784063 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826508-2d3c-4537-9450-d525969156b5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:02.802714 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826508-2d3c-4537-9450-d525969156b5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:02.808998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:02.810146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:02.810643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:02.811481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:02.812661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:02.813315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:02.815145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:02.831379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1261/2497] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:02.835661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:02.846706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925455-2290-4620-8fe8-a173bdef12c3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:02.853505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:02.854700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:02.855131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:02.855609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:02.857639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:02.860304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:02.870493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.905623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1237/2498] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:02 2022] POST /identity/v3/projects => generated 361 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:02.909789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:02.923295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9bc9-fa67-4dad-b76e-a94982f148b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.015841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.016565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.016846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.017138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.017841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.020074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.051502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1262/2499] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:02 2022] POST /identity/v3/users => generated 281 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:03.053245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.070690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d085e-20b9-4192-b029-9055c551ef50 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.076288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.077293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.077747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.078343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.079296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.081780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.099344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1238/2500] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:03.103344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.114948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708e8-3d3f-4bc9-99ce-e160868b9f4b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.121298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.124538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.125028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.125359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.126216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.128768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d323-c051-42b7-926d-91b1ebccc78b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.141601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1263/2501] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:31:03.146163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.160815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3829e8-1ca8-4244-bb23-c8d31e6ca106 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.166075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.166987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.167253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.167570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] PATH_INFO: `/v3/projects/5afb6528a9cc454c81a7b0867db3e4e7/users/7d83ce44724e4a28bc5f3c2fe4b0872e/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.190452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afb6528a9cc454c81a7b0867db3e4e7, user_id=7d83ce44724e4a28bc5f3c2fe4b0872e, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.193484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.210964 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1239/2502] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:03 2022] PUT /identity/v3/projects/5afb6528a9cc454c81a7b0867db3e4e7/users/7d83ce44724e4a28bc5f3c2fe4b0872e/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:03.222846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.223172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.223548 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.255562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] MFA Rules not processed for user `7d83ce44724e4a28bc5f3c2fe4b0872e`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:03.256920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:03.316267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:03.340036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1264/2503] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:03.374295 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.377046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:03.452105 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000424f-60cd-421f-b592-60d485815c36 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.456602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.457357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.457711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.458219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.471079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.473745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2918a-dc42-4c44-88bc-fb4efdb3f933 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.485828 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1240/2504] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:03.505641 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.631248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce31039-969a-4f5e-8a19-401116e7860b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.641637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.644979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.645471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.645892 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] PATH_INFO: `/v3/users/7d83ce44724e4a28bc5f3c2fe4b0872e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.650415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d83ce44724e4a28bc5f3c2fe4b0872e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.652879 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.713634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d83ce44724e4a28bc5f3c2fe4b0872e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:03.723941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d83ce44724e4a28bc5f3c2fe4b0872e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:03.740076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d83ce44724e4a28bc5f3c2fe4b0872e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:03.740791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d83ce44724e4a28bc5f3c2fe4b0872e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:03.749694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d83ce44724e4a28bc5f3c2fe4b0872e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:03.755991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1265/2505] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:03 2022] DELETE /identity/v3/users/7d83ce44724e4a28bc5f3c2fe4b0872e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:03.760799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.761153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.761479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.781062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:03.782290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:03.849941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1241/2506] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:31:03.860279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:03.862655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:03.929013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4a51b-f9c3-49e9-b638-e726a30b36b1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:03.933576 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:03.934329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:03.934677 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:03.935018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:03.945634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:03.947229 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6495-9a43-4e84-8fdc-1e941fde5e19 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:03.957878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1266/2507] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:04.302876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.304473 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:04.317374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287353d-369c-4acb-b245-8e5b64a3950f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.322885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.323845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.324130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.324419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] PATH_INFO: `/v3/projects/5afb6528a9cc454c81a7b0867db3e4e7` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.325677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afb6528a9cc454c81a7b0867db3e4e7)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.327810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.411843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afb6528a9cc454c81a7b0867db3e4e7', 'request_id': 'req-a7bfe193-2851-4e03-a511-06bd1cd2aaab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:04.414902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:04.422907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afb6528a9cc454c81a7b0867db3e4e7', 'request_id': 'req-a7bfe193-2851-4e03-a511-06bd1cd2aaab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:04.435792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afb6528a9cc454c81a7b0867db3e4e7', 'request_id': 'req-a7bfe193-2851-4e03-a511-06bd1cd2aaab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:04.449343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] The token cache is being invalidate because project 5afb6528a9cc454c81a7b0867db3e4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:04.449752 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:04.450492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a7bfe193-2851-4e03-a511-06bd1cd2aaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:04.456228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1242/2508] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:04 2022] DELETE /identity/v3/projects/5afb6528a9cc454c81a7b0867db3e4e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:04.458443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.458731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.459008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.478419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:04.479686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:04.486529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:04.563090 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1267/2509] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:04.567394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.567968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.568404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.598259 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:04.599526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:04.608911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1243/2510] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:04.613239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.628435 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a50788-773a-400a-b15e-f04a5eaad000 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.633831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.634528 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.634808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.635080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.635878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:04.636182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.637860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.651117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1268/2511] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:04.655932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.666332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c92e-5867-4e8d-b402-0e6d978839bc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.671451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.672188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.672544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.672882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.673701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.679075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a7e8-d47f-4d24-a9c1-0183a58f385f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.710069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1244/2512] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:04.714863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.725899 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85817c-4494-4b40-b1a0-5adb9e506530 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.748323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.748522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.748806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.767721 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] MFA Rules not processed for user `8a89c11a8239436d93c2d528afb42622`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:04.769966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:04.787166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.787873 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.788160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.788436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.789141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.791145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.812353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1269/2513] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:04.817939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.827949 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5122a1-0f8b-4195-8ad2-8fbb9897f646 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.832858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.833574 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.833861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.834141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.834893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.836701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.837200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1245/2514] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:04.847386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1270/2515] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:31:04.851690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.863410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62931aa8-fe93-4344-83d7-29ceddb6e7e4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.869139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.869818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.870053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.870361 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.871084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.873482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54abf-1d0f-46de-b544-25c66fd87600 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.886622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1246/2516] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:04.891110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:04.902682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e7d6f-808c-4a20-860c-fe2ef3b0df1e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:04.908161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:04.909154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.909483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.909763 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] PATH_INFO: `/v3/projects/7698fac92732442a91d4bb085fc759b1/users/a64efc2ad0bb4bf58b221b2e62ae3676/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.926296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7698fac92732442a91d4bb085fc759b1, user_id=a64efc2ad0bb4bf58b221b2e62ae3676, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:04.929298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:04.944127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1271/2517] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:04 2022] PUT /identity/v3/projects/7698fac92732442a91d4bb085fc759b1/users/a64efc2ad0bb4bf58b221b2e62ae3676/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:04.950010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdc31-32f5-4745-b1ab-e4bad77f635e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:04.950328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdc31-32f5-4745-b1ab-e4bad77f635e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:04.950560 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdc31-32f5-4745-b1ab-e4bad77f635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:04.970304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1a2cdc31-32f5-4745-b1ab-e4bad77f635e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:04.971551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a2cdc31-32f5-4745-b1ab-e4bad77f635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:05.038753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1247/2518] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:05.062344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:05.064849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:05.123883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f3d-17cb-4ba6-9018-bf5728790b81 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:05.127708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:05.128377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:05.128656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:05.128940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:05.136356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:05.139004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:05.140882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f78550-0ab6-4efa-a510-066faee9d6db service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:05.152363 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1272/2519] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:09.640862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:09.641385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:09.641385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:09.643249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1248/2520] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:31:09.661100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa15b-11ae-4bdd-8251-b17a5ea626a4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:09.661563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa15b-11ae-4bdd-8251-b17a5ea626a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:09.661644 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa15b-11ae-4bdd-8251-b17a5ea626a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:09.691981 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b91fa15b-11ae-4bdd-8251-b17a5ea626a4 None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:09.695546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b91fa15b-11ae-4bdd-8251-b17a5ea626a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:09.833382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1273/2521] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:31:09.848060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:09.850575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:09.950398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:09.964642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26668df8-f044-4858-ae4c-f281d64c96dd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:09.971685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:09.972389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:09.972826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:09.973581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:09.991060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:09.992603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39df185-a0b7-41a9-a86a-d8f9911aa4ee service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:10.023703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1249/2522] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:10.122688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.123230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.123390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.125295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1274/2523] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:31:10.130887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b12e5-b30b-4d53-8c77-8da4618ca367 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.131183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b12e5-b30b-4d53-8c77-8da4618ca367 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.131484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b12e5-b30b-4d53-8c77-8da4618ca367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.167701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cf2b12e5-b30b-4d53-8c77-8da4618ca367 None None] MFA Rules not processed for user `e626b6c267034377a800d89dd1a40bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:10.168966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cf2b12e5-b30b-4d53-8c77-8da4618ca367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:10.194954 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1250/2524] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:10.209481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:10.211508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:10.239231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd60aa4-9b6e-4b19-8715-0ffc8049b434 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:10.244731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:10.245386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.245669 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.246890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.260694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:10.262996 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af64bf-248a-4857-abb0-c927b1a5e676 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:10.273522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1275/2525] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:10.479151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290b9-3b0b-43f6-8c6a-32dcbb1e2fb7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.479808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290b9-3b0b-43f6-8c6a-32dcbb1e2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.480137 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290b9-3b0b-43f6-8c6a-32dcbb1e2fb7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.481875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1251/2526] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:31:10.490228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25b6-6188-40aa-a764-a345bbb9ce5d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.490511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25b6-6188-40aa-a764-a345bbb9ce5d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.491003 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f25b6-6188-40aa-a764-a345bbb9ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.516187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5c9f25b6-6188-40aa-a764-a345bbb9ce5d None None] MFA Rules not processed for user `ab9ee3d95d2549159195ce82240f16ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:10.526251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c9f25b6-6188-40aa-a764-a345bbb9ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:10.539566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1276/2527] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:10.562219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c290b9-3b0b-43f6-8c6a-32dcbb1e2fb7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:10.583199 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c290b9-3b0b-43f6-8c6a-32dcbb1e2fb7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:10.591773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:10.592540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.592702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.593249 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.637478 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:10.639015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:10.658407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1252/2528] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:10.822328 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168370a-885a-416c-9c6f-eff382930eab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:10.822861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168370a-885a-416c-9c6f-eff382930eab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:10.823216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168370a-885a-416c-9c6f-eff382930eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:10.881182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9168370a-885a-416c-9c6f-eff382930eab None None] MFA Rules not processed for user `a64efc2ad0bb4bf58b221b2e62ae3676`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:10.887976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9168370a-885a-416c-9c6f-eff382930eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:11.007126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1277/2529] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:11.011980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.029834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc045b6-e2d6-4f22-ad9b-9084d38eaf64 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.036696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.037581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.038059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.038426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.039115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.041370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.095047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1253/2530] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:11 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:11.099443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168370a-885a-416c-9c6f-eff382930eab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.116540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168370a-885a-416c-9c6f-eff382930eab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.256534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:11.269108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.270593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.271275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.271648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.272481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.274889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.384332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1278/2531] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:11 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:11.388328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.402298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dfaca-d4f4-4ac7-beab-14cf2f1a3ba8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.411339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.412434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.412812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.413227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.414856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.416600 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.466306 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1254/2532] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:11.473100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.493773 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8f4dc-b0d9-45b5-a6ea-65b82a4adf19 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.501375 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.502575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.503534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.503895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] PATH_INFO: `/v3/projects/e5d8770ef1c34230834aeea31d5b0df6/users/7adca1f9351c41f083f5c942ea995d41/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.550270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d8770ef1c34230834aeea31d5b0df6, user_id=7adca1f9351c41f083f5c942ea995d41, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.554472 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.594721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1279/2533] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:11 2022] PUT /identity/v3/projects/e5d8770ef1c34230834aeea31d5b0df6/users/7adca1f9351c41f083f5c942ea995d41/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:11.601903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.621994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da66a7-fcea-4006-b5a3-2b1e0fef0d7e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.770002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.771789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.772227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.772686 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.773576 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.775513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.788794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1255/2534] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:11.794523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:11.812429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf2e1-0798-4e9d-840b-874e86c5aac1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:11.824995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:11.826119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:11.826414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:11.826693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] PATH_INFO: `/v3/projects/e5d8770ef1c34230834aeea31d5b0df6/users/7adca1f9351c41f083f5c942ea995d41/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:11.828948 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d8770ef1c34230834aeea31d5b0df6, user_id=7adca1f9351c41f083f5c942ea995d41, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:11.831699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:11.856288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1280/2535] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:11 2022] PUT /identity/v3/projects/e5d8770ef1c34230834aeea31d5b0df6/users/7adca1f9351c41f083f5c942ea995d41/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:16.874433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:17.082960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b9c-43d4-42cf-bfd7-05d64d2bc6af admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:17.115023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:17.239110 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96995-9fef-4506-9ea6-6cd11dd8d987 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:17.245585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:17.247097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:17.248412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:17.248926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:17.252653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:17.321815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:17.329511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:17.330868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:17.331447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:17.331958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:17.336068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:17.384827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:17.386320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9faa6e-6f03-4250-9a11-0f47f4d3161c service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:17.405584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1281/2536] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:17.436277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:17.438204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:17.450419 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1256/2537] 10.222.0.82 () {60 vars in 1396 bytes} [Wed Jul 20 19:31:16 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:17.768344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ecce-1c44-47cb-ba52-bfd53a8aad10 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:17.768642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ecce-1c44-47cb-ba52-bfd53a8aad10 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:17.768925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ecce-1c44-47cb-ba52-bfd53a8aad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:17.795335 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-47c1ecce-1c44-47cb-ba52-bfd53a8aad10 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:17.797019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-47c1ecce-1c44-47cb-ba52-bfd53a8aad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:17.919612 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1282/2538] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:17.931531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:17.933012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:18.026700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1229-b3ca-440f-bb00-a18ba2571bf5 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:18.033797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:18.035211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:18.035770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:18.036260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:18.057822 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:18.072727 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:18.104883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1257/2539] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:19.826223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3845-77b0-4e96-9e0a-05e677711c9b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:19.826782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3845-77b0-4e96-9e0a-05e677711c9b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:19.827027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3845-77b0-4e96-9e0a-05e677711c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:19.883880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:19.902511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a64b3845-77b0-4e96-9e0a-05e677711c9b None None] MFA Rules not processed for user `7adca1f9351c41f083f5c942ea995d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:19.906022 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a64b3845-77b0-4e96-9e0a-05e677711c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:20.028971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1283/2540] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:20.037625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:20.054830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4d676-76eb-4576-950d-7ec5c52f04a5 service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:20.062176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:20.063161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:20.064243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:20.065375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:20.208595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:20.212247 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:20.238447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1258/2541] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:20.456325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:20.457161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:20.457673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:20.511338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:20.513295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:20.544693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1284/2542] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:20.580924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:20.601791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5e14f-8d19-4ea1-a840-b746309453eb service glance] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:20.613003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:20.613672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:20.614134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:20.614525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:20.635553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:20.638301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:20.659825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1259/2543] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:24.619005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:24.660806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f18ca-5ac0-4c3f-b0f3-4187210a0b29 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:24.675833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:24.676780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:24.677241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:24.677667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:24.679973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:24.826217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:24.827861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:24.842790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1285/2544] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:30.648887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:31.499667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:31.501426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:31.691414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:31.692982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:31.721291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a857-6b2d-4ce1-b767-b90c56132e78 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:31.784300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:31.792324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:31.793219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:31.797929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] PATH_INFO: `/v3/users/f6c8fbe67885443b8e373c8af032f86f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:31.812706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8fbe67885443b8e373c8af032f86f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:31.821627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:31.843294 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea262-690b-4517-a366-7f00933875ed service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:31.876115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:31.876836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:31.877118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:31.877386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:31.888238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:31.923700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:31.925410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:31.980157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1260/2545] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:32.068704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8fbe67885443b8e373c8af032f86f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.081473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8fbe67885443b8e373c8af032f86f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.115734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8fbe67885443b8e373c8af032f86f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.118902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8fbe67885443b8e373c8af032f86f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.133339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:32.146315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-be433d2e-c90d-4ca0-a40c-f26fddd9038a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8fbe67885443b8e373c8af032f86f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.177853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1286/2546] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:31 2022] DELETE /identity/v3/users/f6c8fbe67885443b8e373c8af032f86f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:31:32.560378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:32.575404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d64d-02c5-46a5-aece-2cf7ea6d1c9d service placement] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:32.744548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:32.745444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:32.747627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:32.747919 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] PATH_INFO: `/v3/projects/2cbdbe7db9f54423a1f54538297f4919` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:32.751079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbdbe7db9f54423a1f54538297f4919)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:32.756973 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:32.833161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbdbe7db9f54423a1f54538297f4919', 'request_id': 'req-7923f41c-89ef-4f58-b954-1bdaa1f113c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.840404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbdbe7db9f54423a1f54538297f4919', 'request_id': 'req-7923f41c-89ef-4f58-b954-1bdaa1f113c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.850139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbdbe7db9f54423a1f54538297f4919', 'request_id': 'req-7923f41c-89ef-4f58-b954-1bdaa1f113c3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.870263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] The token cache is being invalidate because project 2cbdbe7db9f54423a1f54538297f4919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:32.870782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.871636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7923f41c-89ef-4f58-b954-1bdaa1f113c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:32.873504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1261/2547] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:32 2022] DELETE /identity/v3/projects/2cbdbe7db9f54423a1f54538297f4919 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:32.878619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:32.879166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:32.879166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:32.904334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:32.905903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:32.999427 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1287/2548] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:33.007290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.007596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.007940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.030613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:33.031924 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:33.044565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1262/2549] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:33.044864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.055508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d395-e947-4376-b50a-9b9f5ffce100 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.060976 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.061782 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.062167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.062545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.063439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:33.063845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.066377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.084549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1288/2550] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:33.088904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.099723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006699ab-f1f9-47e8-80a7-7358f8263393 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.104817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.105605 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.105984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.106355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.107170 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.109285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.121337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:33.157749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1263/2551] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:33.161502 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.177099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6bad0-15ed-44dd-a685-dfe268a7fe43 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.261609 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.262312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.263217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.263217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.263623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.265830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.304853 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1289/2552] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:33.308568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.324877 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2babca4-6d14-4467-9733-59df116b1871 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.330162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.335300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.335703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.336098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.336977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.339110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.351112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1264/2553] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:33.355340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.366401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746329c8-14a6-4981-9725-c432aaba8913 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.371776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.372556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.372906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.373257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.374153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.376249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2d8c-9af0-4cad-887d-f66561398fb0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.391062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1290/2554] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:33.392248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.403093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4107-edbd-49f1-8316-e38223bedcab admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.411405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.412621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.412849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.413176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] PATH_INFO: `/v3/projects/fc316ceda6f14249a79a5309cd657c22/users/0b2f0f4cd0234cfc85a2b026bcbcea82/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.429843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc316ceda6f14249a79a5309cd657c22, user_id=0b2f0f4cd0234cfc85a2b026bcbcea82, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.432644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.449263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1265/2555] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:33 2022] PUT /identity/v3/projects/fc316ceda6f14249a79a5309cd657c22/users/0b2f0f4cd0234cfc85a2b026bcbcea82/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:33.460848 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.461404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.461683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.491925 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] MFA Rules not processed for user `0b2f0f4cd0234cfc85a2b026bcbcea82`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:33.493154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:33.563169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:33.588353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1291/2556] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:33.592601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.674432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beba10b-1b53-47d2-9aff-cd3976bb1918 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.679726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.680520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.680884 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.681159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.682051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.684794 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.714913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1266/2557] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:33.718765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.730324 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ffac4-ab87-4f24-a444-09d29727f3bb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.790818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.792212 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.792494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.792762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.793635 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.795659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.823929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1292/2558] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:33.828402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.839911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666690-8ab8-4682-9721-351f8f044909 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.845203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.846117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.846403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.847218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.847494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.849285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e66bb-b0ed-45fd-8e09-8020d0ad354e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.862639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1267/2559] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:33.867359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.880197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f890b-15f8-4134-810b-42e92a4a30d9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:33.888161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:33.889741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.890143 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.890482 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] PATH_INFO: `/v3/projects/1dda2d59406c4fd698f6bf75df34b683/users/18233435a2f1453e8b41f51264ed2d51/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.918754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dda2d59406c4fd698f6bf75df34b683, user_id=18233435a2f1453e8b41f51264ed2d51, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:33.922353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:33.931807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa46c4-be84-4eac-be98-40aae780d545 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:33.932200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa46c4-be84-4eac-be98-40aae780d545 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:33.932394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa46c4-be84-4eac-be98-40aae780d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:33.938911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1293/2560] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:33 2022] PUT /identity/v3/projects/1dda2d59406c4fd698f6bf75df34b683/users/18233435a2f1453e8b41f51264ed2d51/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:31:33.945513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:33.955983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2eaa46c4-be84-4eac-be98-40aae780d545 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:33.957453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2eaa46c4-be84-4eac-be98-40aae780d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.048363 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1268/2561] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:34.053023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.053335 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.053622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.063097 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57df2f-3692-4e8f-9513-83aaa6fa00eb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.068584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.069590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.069877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.070206 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.071080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.072943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.073069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] MFA Rules not processed for user `a64efc2ad0bb4bf58b221b2e62ae3676`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:34.074274 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.090824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1294/2562] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:34.090824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:34.090824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.108591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:34.139125 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1269/2563] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:34.140221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:34.152321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d9a4-56bf-4e3a-a211-29db2c455619 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.158198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:34.158374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.159248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.159573 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.160312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] PATH_INFO: `/v3/projects/1dda2d59406c4fd698f6bf75df34b683/users/18233435a2f1453e8b41f51264ed2d51/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.164106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dda2d59406c4fd698f6bf75df34b683, user_id=18233435a2f1453e8b41f51264ed2d51, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.168299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2312-9fa5-458c-a6bf-09bdb22afd45 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.179960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503da9-cef4-4ac5-823b-9f44d7a453dd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.180631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1270/2564] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:34 2022] PUT /identity/v3/projects/1dda2d59406c4fd698f6bf75df34b683/users/18233435a2f1453e8b41f51264ed2d51/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:34.190771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.191062 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.191378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.222030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] MFA Rules not processed for user `18233435a2f1453e8b41f51264ed2d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:34.223257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.252281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.253036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.253369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.253779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.318842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1271/2565] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:31:34.326639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:34.328480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.330982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.333521 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.344566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1295/2566] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:34.419876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9f8d-7639-448b-bf42-c21b5ffadb92 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.431522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.432397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.432777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.433150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.446829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.448585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.479054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1272/2567] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:34.532913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:34.534985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.569268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:34.584030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68617d-b6c5-4c4b-9bdc-f3bc0225a859 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.594309 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.595533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.595813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.596083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.617006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5d2f-592a-4ed6-ba31-d9e36e384bf6 service swift] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:34.627017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:34.635824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:34.636145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:34.636682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:34.646025 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:34.675291 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.677562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bed395-a707-4792-94cb-9ffa9c099f14 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.684585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:34.690126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:34.692043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1296/2568] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:34.692215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:34.709325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1273/2569] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:37.086990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251be1-21b1-4c47-9707-d261fc5e59ae None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:37.087511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251be1-21b1-4c47-9707-d261fc5e59ae None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:37.087658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251be1-21b1-4c47-9707-d261fc5e59ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:37.107068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-35251be1-21b1-4c47-9707-d261fc5e59ae None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:37.108550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-35251be1-21b1-4c47-9707-d261fc5e59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:37.126109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1297/2570] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:37.146182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:37.164231 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b03f2a-2837-4cc4-a759-aaade1b47888 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:37.175974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:37.176817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:37.177336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:37.177707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:37.193292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:37.197428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:37.214621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1274/2571] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:47.101354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=86 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:47.207764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=9 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:48.859786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b79bc-5dc7-4de6-8f07-bfb8ce6e223d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:48.860916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b79bc-5dc7-4de6-8f07-bfb8ce6e223d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:48.860916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b79bc-5dc7-4de6-8f07-bfb8ce6e223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:48.884506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5d7b79bc-5dc7-4de6-8f07-bfb8ce6e223d None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:48.885930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5d7b79bc-5dc7-4de6-8f07-bfb8ce6e223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:48.893998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1298/2572] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:31:48.915425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:48.931668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e7c8e-1c5e-48b8-94fb-7cce3253dc9a service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:48.938209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:48.939163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:48.939717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:48.940194 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:48.953690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:48.955433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:48.966175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1275/2573] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:55.110357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.111230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.111230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.133170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:55.134454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:55.145634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1299/2574] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:55.172282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.184332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859eac-f09a-4adb-8554-fe4e5a56dd9a service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.191549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.192218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.192503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.192765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.202372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.204021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.213392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1276/2575] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:57.259917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:57.262091 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:57.346144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b71a0-263e-4a55-94fa-f1e44bd69d1b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:57.351606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:57.352534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:57.352814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:57.353087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] PATH_INFO: `/v3/users/8a89c11a8239436d93c2d528afb42622` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:57.354362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a89c11a8239436d93c2d528afb42622)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:57.356452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:57.407406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a89c11a8239436d93c2d528afb42622'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.415537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a89c11a8239436d93c2d528afb42622'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.432350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a89c11a8239436d93c2d528afb42622'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.433706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a89c11a8239436d93c2d528afb42622'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.442373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5c7807bb-415d-45a9-af1b-a0dc6092033c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a89c11a8239436d93c2d528afb42622'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.448945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1300/2576] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:57 2022] DELETE /identity/v3/users/8a89c11a8239436d93c2d528afb42622 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:57.654386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:57.665961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde03b8-bd71-4e9a-a78c-0b250732f3a7 service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:57.733355 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:57.734098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:57.734446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:57.734792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] PATH_INFO: `/v3/projects/8cc7273a171847b1961f0e8557649b80` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:57.736058 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc7273a171847b1961f0e8557649b80)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:57.738091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:57.789801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc7273a171847b1961f0e8557649b80', 'request_id': 'req-7150bc2f-7504-4c3f-a47a-8141dd9ea193'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.796354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc7273a171847b1961f0e8557649b80', 'request_id': 'req-7150bc2f-7504-4c3f-a47a-8141dd9ea193'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.805350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc7273a171847b1961f0e8557649b80', 'request_id': 'req-7150bc2f-7504-4c3f-a47a-8141dd9ea193'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.816614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] The token cache is being invalidate because project 8cc7273a171847b1961f0e8557649b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:57.816900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.817553 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-7150bc2f-7504-4c3f-a47a-8141dd9ea193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:57.819153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1277/2577] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:57 2022] DELETE /identity/v3/projects/8cc7273a171847b1961f0e8557649b80 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:57.824725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:57.825031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:57.825313 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:57.844209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:57.845517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:57.923508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1301/2578] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:57.930880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:57.931290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:57.932048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:57.951668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:57.953003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:57.965968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1278/2579] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:57.970535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:57.980658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665e6a-97f2-4d31-b502-5369be884079 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:57.985374 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:57.986035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:57.986311 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:57.986582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:57.987330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:57.987631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:57.989236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:57.990829 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:58.007481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1302/2580] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:58.007714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.017165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c5996-4635-43ae-b79d-01e79a329bcd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.022539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.023202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.023587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.023947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.024603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.026530 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.059446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1279/2581] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:58.060453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.071639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f729-8b7f-4f05-93e7-ecadecebab4c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.131480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.132169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.132453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.132750 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.133478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.135418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.160523 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1303/2582] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:31:58.161890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.173883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518611dc-742e-4802-ac10-1034fe060a8b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.179953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.180638 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.180915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.181180 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.181912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.184670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.197129 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1280/2583] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:58.201755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.213804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1f5d-38ed-4b2b-8d7e-ae093d4976a4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.219054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.220485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.220969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.221476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.222458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.227489 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57965ac-99c9-413d-ab10-ef952f199712 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.238305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1304/2584] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:58.243009 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.255221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044281c-5dad-4d89-bc71-7a1afdf310f3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.261422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.262326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.262602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.262876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] PATH_INFO: `/v3/projects/f8901086267548249dba5019e90074e4/users/a9923a19351b4ae9b57f3af8d4fd6642/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.282406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8901086267548249dba5019e90074e4, user_id=a9923a19351b4ae9b57f3af8d4fd6642, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.285200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.295979 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:58.303539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1281/2585] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:58 2022] PUT /identity/v3/projects/f8901086267548249dba5019e90074e4/users/a9923a19351b4ae9b57f3af8d4fd6642/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:31:58.316724 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.317973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.318422 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.351765 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] MFA Rules not processed for user `a9923a19351b4ae9b57f3af8d4fd6642`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:58.353015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.437569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1305/2586] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:58.450682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.452474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.520986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb5e6-5924-45c2-82c2-3a2b9a0429d6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.526292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.527260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.527603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.528369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.538107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.539909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.549354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1282/2587] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:01.003533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:01.005440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:01.066922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec939f-6617-46fe-b132-c546168e3583 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:01.071834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:01.072554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:01.072832 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:01.073102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:01.074993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:01.090563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:01.146767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:01.148334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:01.159789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1306/2588] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:02.847493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:02.849123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:02.967124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753531-7f87-4131-bc6a-50a6cc606152 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:02.973168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:02.973834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:02.974291 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:02.974567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:02.976556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:02.993109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:02.993109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e862a-a0a0-490d-88f9-4b9160aa24d5 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.017182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1283/2589] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:03.677347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.754073 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7cf-3530-443c-aedd-6b769364610e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.759658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.760821 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.761213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.761579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] PATH_INFO: `/v3/users/a9923a19351b4ae9b57f3af8d4fd6642` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.763109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9923a19351b4ae9b57f3af8d4fd6642)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.765423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.872968 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9923a19351b4ae9b57f3af8d4fd6642'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.887011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9923a19351b4ae9b57f3af8d4fd6642'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.910173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9923a19351b4ae9b57f3af8d4fd6642'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.911360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9923a19351b4ae9b57f3af8d4fd6642'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.923425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9923a19351b4ae9b57f3af8d4fd6642'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.932956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1307/2590] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:03 2022] DELETE /identity/v3/users/a9923a19351b4ae9b57f3af8d4fd6642 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:03.937737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.939026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.939563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.958075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:03.960006 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:04.087793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.089737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:04.092012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1284/2591] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:04.150208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:04.194791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff3f4-1682-48cd-be4b-cd7dfa7243b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.203924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.204723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.205221 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.205595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.215993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.217659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.229268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1308/2592] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:32:04.525240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.526975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:04.552301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98f38-e156-420b-bb9b-3d686b02213e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.558732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.559804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.560177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.560500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] PATH_INFO: `/v3/projects/f8901086267548249dba5019e90074e4` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.561930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8901086267548249dba5019e90074e4)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.563965 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.590907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:04.625959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8901086267548249dba5019e90074e4', 'request_id': 'req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:04.633250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8901086267548249dba5019e90074e4', 'request_id': 'req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:04.641655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8901086267548249dba5019e90074e4', 'request_id': 'req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:04.654799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] The token cache is being invalidate because project f8901086267548249dba5019e90074e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:04.655081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:04.655759 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ca6a03c3-9ed1-4e44-8693-d68da7079ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:04.657495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1285/2593] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:04 2022] DELETE /identity/v3/projects/f8901086267548249dba5019e90074e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:07.053595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:07.055267 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:07.068711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87b19-4c8a-4737-809f-09b370a39bc6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:07.142800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:07.144085 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:07.144451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:07.144838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] PATH_INFO: `/v3/users/0b2f0f4cd0234cfc85a2b026bcbcea82` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:07.146811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2f0f4cd0234cfc85a2b026bcbcea82)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:07.149590 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:07.208150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2f0f4cd0234cfc85a2b026bcbcea82'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.216883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2f0f4cd0234cfc85a2b026bcbcea82'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.229730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2f0f4cd0234cfc85a2b026bcbcea82'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.230386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2f0f4cd0234cfc85a2b026bcbcea82'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.237614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2f0f4cd0234cfc85a2b026bcbcea82'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.246213 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1309/2594] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:07 2022] DELETE /identity/v3/users/0b2f0f4cd0234cfc85a2b026bcbcea82 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:07.250905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:07.251424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:07.251552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:07.270639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:07.271909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:07.334659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1286/2595] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:07.344593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:07.346043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:07.406497 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d31e7-0551-491f-aa58-7c9da75582be admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:07.411211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:07.411893 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:07.412178 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:07.412452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:07.420156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:07.422476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:07.424498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:07.437784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1310/2596] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:07.742182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:07.743834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:07.756672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395ee60-1232-4089-b67f-a7a46a371066 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:07.762684 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:07.763705 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:07.763987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:07.764261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] PATH_INFO: `/v3/projects/fc316ceda6f14249a79a5309cd657c22` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:07.765646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc316ceda6f14249a79a5309cd657c22)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:07.767706 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:07.827169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc316ceda6f14249a79a5309cd657c22', 'request_id': 'req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.833843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc316ceda6f14249a79a5309cd657c22', 'request_id': 'req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.842702 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc316ceda6f14249a79a5309cd657c22', 'request_id': 'req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.853562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] The token cache is being invalidate because project fc316ceda6f14249a79a5309cd657c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:07.853846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.854525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:07.856160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1287/2597] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:07 2022] DELETE /identity/v3/projects/fc316ceda6f14249a79a5309cd657c22 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:07.860343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:07.870702 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85899f-51ce-428b-af32-62c823077385 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:07.942088 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:07.942979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:07.943264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:07.943532 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] PATH_INFO: `/v3/users/18233435a2f1453e8b41f51264ed2d51` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:07.944849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18233435a2f1453e8b41f51264ed2d51)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:07.946793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:07.997513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18233435a2f1453e8b41f51264ed2d51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.005800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18233435a2f1453e8b41f51264ed2d51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.018152 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18233435a2f1453e8b41f51264ed2d51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.018814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18233435a2f1453e8b41f51264ed2d51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.026255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d81a6f97-84e2-43b4-bbf4-4090f60c994f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18233435a2f1453e8b41f51264ed2d51'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.032982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1311/2598] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:07 2022] DELETE /identity/v3/users/18233435a2f1453e8b41f51264ed2d51 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:08.320365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.322598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:08.337459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0898f-aa01-47ee-8b8d-8c9a56da2d03 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.373201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:08.398961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.399921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.400261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.400515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] PATH_INFO: `/v3/projects/1dda2d59406c4fd698f6bf75df34b683` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.401742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dda2d59406c4fd698f6bf75df34b683)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.404026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.455664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dda2d59406c4fd698f6bf75df34b683', 'request_id': 'req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.461857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dda2d59406c4fd698f6bf75df34b683', 'request_id': 'req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.470529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dda2d59406c4fd698f6bf75df34b683', 'request_id': 'req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.481708 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] The token cache is being invalidate because project 1dda2d59406c4fd698f6bf75df34b683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:08.481986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.482664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2dce2634-ed95-4b8a-99f9-5d89a61a6f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:08.484490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1288/2599] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:08 2022] DELETE /identity/v3/projects/1dda2d59406c4fd698f6bf75df34b683 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:08.489442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.489935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.490042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.508133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:08.509420 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:08.570592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1312/2600] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:08.581173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.581760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.582313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.607749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:08.608981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:08.618282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1289/2601] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:08.622932 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.633621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea47d-6363-40a2-9715-c8ffd8beac61 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.639633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.640320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.640617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.640889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.641617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:08.641922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.643642 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.662332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1313/2602] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:08.667007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.676615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80d892-5833-4d40-87eb-08699c712898 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.681921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.682580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.682865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.683138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.683894 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.685827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.717102 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1290/2603] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:08 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:08.723128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.728672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:08.735823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa11c-4648-4ecd-b1e9-ce8e04af4da6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.798594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.799330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.799634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.799923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.800617 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.802565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.825509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1314/2604] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:08 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:08.831713 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.845327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb5da-9876-4707-8536-95709466beb2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.850349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.851178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.851488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.851782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.852509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.854130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.865205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1291/2605] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:08.869783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.880666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20160ae-2891-440a-b040-45a1bbd93876 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.887334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.888051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.888332 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.888605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.889337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.890960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dca98-5265-454e-9cb8-c956fe5ac0ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.902170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1315/2606] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:08.906843 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:08.919281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10bd6-eafc-432c-ba48-9fcefd3d1c1f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:08.926165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:08.927089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.927393 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.927670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] PATH_INFO: `/v3/projects/6a0db7b0a095407d9af2b3c402b483ed/users/f857765110654a6aa3b14e9b538265f5/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:08.943741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0db7b0a095407d9af2b3c402b483ed, user_id=f857765110654a6aa3b14e9b538265f5, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:08.946433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:08.961617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1292/2607] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:08 2022] PUT /identity/v3/projects/6a0db7b0a095407d9af2b3c402b483ed/users/f857765110654a6aa3b14e9b538265f5/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:08.973234 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:08.973696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:08.974041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.009208 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] MFA Rules not processed for user `f857765110654a6aa3b14e9b538265f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:09.010440 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:09.085767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1316/2608] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:09.091785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.157887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e91b-3bbe-4c7b-89a9-0fe12466e0da admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.163518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.164198 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.164456 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.164753 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.165564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.167526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.171881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:09.201587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1293/2609] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:09 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:09.205695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.216946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c7e85-e620-4756-ad63-be4b4bf65d43 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.280661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.281344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.281597 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.281911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.282588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.284638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.303080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:09.317103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1317/2610] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:09 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:09.319332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.331862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5204-ff0e-4184-9444-e6dc3b0ea88d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.337481 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.338080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.338346 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.338612 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.339349 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.341045 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.352647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1294/2611] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:09.357176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.367841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae304b-31f7-41c6-8631-090812cd2d61 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.373029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.373931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.374241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.374561 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] PATH_INFO: `/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a/users/3c750b877f0d4492aa5b860cd95b6b35/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.390320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee9d9133b0044b38bd9fe5c7980537a, user_id=3c750b877f0d4492aa5b860cd95b6b35, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.393038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.407931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1318/2612] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:09 2022] PUT /identity/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a/users/3c750b877f0d4492aa5b860cd95b6b35/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:09.412603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.427273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8c10c-8a9f-4566-b3a3-53ca4806c02a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.488466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.489178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.489454 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.489730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.490472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.492146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395c571-8809-4620-b84c-18c970c04097 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.502413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1295/2613] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:09.506638 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.517717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a52d3-c4ae-452f-9c85-fb941ae0d157 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.526376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.528606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.528889 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.529166 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] PATH_INFO: `/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a/users/3c750b877f0d4492aa5b860cd95b6b35/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.531715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee9d9133b0044b38bd9fe5c7980537a, user_id=3c750b877f0d4492aa5b860cd95b6b35, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.534483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.547273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1319/2614] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:09 2022] PUT /identity/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a/users/3c750b877f0d4492aa5b860cd95b6b35/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:09.562353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc7393-a850-4475-92ba-99990351558a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.562643 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc7393-a850-4475-92ba-99990351558a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.562943 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc7393-a850-4475-92ba-99990351558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.590673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2efc7393-a850-4475-92ba-99990351558a None None] MFA Rules not processed for user `3c750b877f0d4492aa5b860cd95b6b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:09.591826 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2efc7393-a850-4475-92ba-99990351558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:09.679443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1296/2615] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:09.695320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:09.698545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:09.773406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732698b3-faf7-460b-88f3-1696be730c13 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:09.778543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:09.779205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:09.779520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:09.779803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:09.789730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:09.791322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e57c8-8b95-4642-8d1f-2aed900fa807 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:09.801059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1320/2616] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:11.328831 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc7393-a850-4475-92ba-99990351558a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:11.404344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:11.409186 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc7393-a850-4475-92ba-99990351558a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:11.415114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:11.416030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:11.416315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:11.416597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] PATH_INFO: `/v3/users/f857765110654a6aa3b14e9b538265f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:11.418177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f857765110654a6aa3b14e9b538265f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:11.420169 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:11.475163 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f857765110654a6aa3b14e9b538265f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:11.482087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f857765110654a6aa3b14e9b538265f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:11.490668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f857765110654a6aa3b14e9b538265f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:11.491290 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f857765110654a6aa3b14e9b538265f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:11.491935 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f857765110654a6aa3b14e9b538265f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:11.510474 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1297/2617] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:11 2022] DELETE /identity/v3/users/f857765110654a6aa3b14e9b538265f5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:11.516015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:11.516795 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:11.516945 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:11.538535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:11.539835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:11.605320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1321/2618] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:11.615121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:11.616774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:11.677603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e039f08-7426-4f25-9d22-1ccb5a13a546 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:11.681852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:11.682502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:11.682778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:11.683050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:11.692500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:11.694085 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:11.703962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1298/2619] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:11.993447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:11.994926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:12.018425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc334a1-2056-451d-a53e-3d5842dfa051 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:12.023485 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:12.024407 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.024766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.024947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] PATH_INFO: `/v3/projects/6a0db7b0a095407d9af2b3c402b483ed` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.026136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0db7b0a095407d9af2b3c402b483ed)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:12.028439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:12.075860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0db7b0a095407d9af2b3c402b483ed', 'request_id': 'req-17af8111-2ca5-4131-80c8-e79926407bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.083705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0db7b0a095407d9af2b3c402b483ed', 'request_id': 'req-17af8111-2ca5-4131-80c8-e79926407bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.090249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0db7b0a095407d9af2b3c402b483ed', 'request_id': 'req-17af8111-2ca5-4131-80c8-e79926407bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.091594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:12.103966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] The token cache is being invalidate because project 6a0db7b0a095407d9af2b3c402b483ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:12.104256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.104933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.106566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1322/2620] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:11 2022] DELETE /identity/v3/projects/6a0db7b0a095407d9af2b3c402b483ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:12.110813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:12.121845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421ddb-7a42-4a43-a838-d65a6a6f31bb service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:12.188717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:12.189743 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.190131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.190528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] PATH_INFO: `/v3/users/3c750b877f0d4492aa5b860cd95b6b35` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.192504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c750b877f0d4492aa5b860cd95b6b35)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:12.195021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:12.223321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:12.254091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c750b877f0d4492aa5b860cd95b6b35'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.261134 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c750b877f0d4492aa5b860cd95b6b35'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.270285 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c750b877f0d4492aa5b860cd95b6b35'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.270968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c750b877f0d4492aa5b860cd95b6b35'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.271658 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-2d509524-e354-4eae-8049-75ab3b7210aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c750b877f0d4492aa5b860cd95b6b35'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.292472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1299/2621] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:12 2022] DELETE /identity/v3/users/3c750b877f0d4492aa5b860cd95b6b35 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:12.586333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:12.587845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:12.602198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8111-2ca5-4131-80c8-e79926407bcb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:12.664916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:12.665905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.666188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.666467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] PATH_INFO: `/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.667748 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee9d9133b0044b38bd9fe5c7980537a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:12.669691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:12.729614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee9d9133b0044b38bd9fe5c7980537a', 'request_id': 'req-59cee60b-e696-4a45-9c7e-c7d94ac1589e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.738506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee9d9133b0044b38bd9fe5c7980537a', 'request_id': 'req-59cee60b-e696-4a45-9c7e-c7d94ac1589e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.745418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee9d9133b0044b38bd9fe5c7980537a', 'request_id': 'req-59cee60b-e696-4a45-9c7e-c7d94ac1589e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.757625 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] The token cache is being invalidate because project 7ee9d9133b0044b38bd9fe5c7980537a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:12.757935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.758729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59cee60b-e696-4a45-9c7e-c7d94ac1589e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:12.760508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1323/2622] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:12 2022] DELETE /identity/v3/projects/7ee9d9133b0044b38bd9fe5c7980537a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:12.765859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.766382 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.766480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.785063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:12.786282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:12.848754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1300/2623] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:12.857246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.857549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.857858 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.877505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:12.878744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:12.887019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1324/2624] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:12.891496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:12.901710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1148-3f1a-4d55-9c0b-563a6c283e89 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:12.907030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:12.907756 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.908035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.908323 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.909111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:12.909410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:12.911023 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:12.926483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1301/2625] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:12.927826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:12.937713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb513262-b7c3-4c56-a4f3-3077a4071a7d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:12.942880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:12.943558 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:12.943837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:12.944127 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:12.944835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:12.946804 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:12.985984 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1325/2626] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:12 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:12.992350 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.003719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7b72-6c10-45f5-b5bc-3a7a2c8377c4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.067433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.068094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.068394 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.068661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.069420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.071338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.094857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1302/2627] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:12 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:13.099296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.111341 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671ebc-3344-4421-99da-f1734f89a2cb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.117181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.117850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.118128 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.118382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.119223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.120844 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.131768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1326/2628] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:13.136089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.146567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e23ac3-1f04-4658-8e4e-a5e0358bef39 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.151719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.152384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.152963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.153257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.154019 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.155660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4b45-14d7-4a04-af81-98a11a426b3b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.166115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1303/2629] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:13.172897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.186458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603a2c-7f47-4579-bb08-c2bf53149310 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.192030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.192912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.193192 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.193477 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] PATH_INFO: `/v3/projects/e34c4dfd621d4280bf264de1e53efbde/users/bce4bd7342f14a55b0d1c257bf91271f/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.210069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34c4dfd621d4280bf264de1e53efbde, user_id=bce4bd7342f14a55b0d1c257bf91271f, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.212924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.229040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1327/2630] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:13 2022] PUT /identity/v3/projects/e34c4dfd621d4280bf264de1e53efbde/users/bce4bd7342f14a55b0d1c257bf91271f/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:13.240598 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.240853 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.241207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.250786 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:13.273552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] MFA Rules not processed for user `bce4bd7342f14a55b0d1c257bf91271f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:13.274791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:13.350823 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1304/2631] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:13.356686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.376492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:13.432672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64ecf-310b-4524-a721-56967c5b21b0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.440479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.440731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.441171 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.441592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.442796 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.446233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.475261 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1328/2632] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:13 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:13.479581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.490372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db76f-11bc-4bc2-83d9-665a84a14f14 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.554288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.554880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.555157 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.555468 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.556182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.558143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.580236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1305/2633] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:13 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:13.584254 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.595445 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc1bc-82ae-46ad-bc7e-a152c083722c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.600952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.601655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.601941 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.602220 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.602950 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.604623 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.616645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1329/2634] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:13.622122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.633432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f39d-dca4-4f3e-8713-400d648e267d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.639435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.640338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.640615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.640887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] PATH_INFO: `/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87/users/1d9757f247f4484fad813b7bff31dbc5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.658031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbd1641fe2a49c8b3dc90c686400b87, user_id=1d9757f247f4484fad813b7bff31dbc5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.660829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.675300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1306/2635] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:13 2022] PUT /identity/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87/users/1d9757f247f4484fad813b7bff31dbc5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:13.680071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.691020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acb37-b0d7-4c5f-b370-696efa5c0f6f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.758854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.759577 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.759854 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.760115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.760837 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.762428 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d3f71-27af-416f-8eb2-e699eed7014b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.772721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1330/2636] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:13.778139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.793995 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3d7a2-a9b1-40a6-b894-0e5154a9f891 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:13.802278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:13.803779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.804237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.804779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] PATH_INFO: `/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87/users/1d9757f247f4484fad813b7bff31dbc5/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.808090 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbd1641fe2a49c8b3dc90c686400b87, user_id=1d9757f247f4484fad813b7bff31dbc5, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:13.810887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:13.823075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1307/2637] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:13 2022] PUT /identity/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87/users/1d9757f247f4484fad813b7bff31dbc5/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:13.835087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291628-622c-4f86-ace2-eb262565735a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:13.835377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291628-622c-4f86-ace2-eb262565735a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:13.835660 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef291628-622c-4f86-ace2-eb262565735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:13.867685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ef291628-622c-4f86-ace2-eb262565735a None None] MFA Rules not processed for user `1d9757f247f4484fad813b7bff31dbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:13.868967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ef291628-622c-4f86-ace2-eb262565735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:13.943869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1331/2638] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:13.957053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:13.958793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:14.017048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.023771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38747-0b01-4a6c-939a-2b12195777a0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:14.028619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:14.029284 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:14.029585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:14.029862 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:14.039513 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:14.041036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:14.051397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1308/2639] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:14.385758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291628-622c-4f86-ace2-eb262565735a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:14.395755 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef291628-622c-4f86-ace2-eb262565735a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:14.401774 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9757f247f4484fad813b7bff31dbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fbd1641fe2a49c8b3dc90c686400b87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:14.402772 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:14.403049 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:14.403340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:14.404083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:14.404395 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:14.406015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:14.413107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.419850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1332/2640] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:14.423880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:14.433493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e5b4a-85c1-46f1-a5ca-d18b43a4ffbe service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:14.439219 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9757f247f4484fad813b7bff31dbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fbd1641fe2a49c8b3dc90c686400b87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:14.439913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:14.440200 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:14.440487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:14.441245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:14.443220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:14.481470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1309/2641] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:14 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:14.486249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:14.499151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a12a5-bc9a-4c3a-8824-9b01daefdb81 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:14.557582 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9757f247f4484fad813b7bff31dbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fbd1641fe2a49c8b3dc90c686400b87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:14.558249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:14.558546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:14.558825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:14.559586 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:14.559900 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:14.561544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:14.574963 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1333/2642] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:14.612426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:14.625073 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d402-ac65-44a4-b18f-085257812803 tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:14.630374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9757f247f4484fad813b7bff31dbc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fbd1641fe2a49c8b3dc90c686400b87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:14.631250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:14.631566 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:14.631841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] PATH_INFO: `/v3/projects/37b2a0abe14e49e1bcd7fbffdd42309c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:14.633093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37b2a0abe14e49e1bcd7fbffdd42309c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:14.634997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:14.686941 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b2a0abe14e49e1bcd7fbffdd42309c', 'request_id': 'req-98d5b27d-189d-483f-94b9-f77eb33f13ed'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:14.694337 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b2a0abe14e49e1bcd7fbffdd42309c', 'request_id': 'req-98d5b27d-189d-483f-94b9-f77eb33f13ed'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:14.705367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b2a0abe14e49e1bcd7fbffdd42309c', 'request_id': 'req-98d5b27d-189d-483f-94b9-f77eb33f13ed'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:14.716601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] The token cache is being invalidate because project 37b2a0abe14e49e1bcd7fbffdd42309c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:14.716907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:14.717595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-98d5b27d-189d-483f-94b9-f77eb33f13ed tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:14.719216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1310/2643] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:14 2022] DELETE /identity/v3/projects/37b2a0abe14e49e1bcd7fbffdd42309c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:14.928707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:14.930664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:15.001649 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa0b48-6eaf-4f2f-99ac-93b28983078d tempest-VolumeQuotaClassesTest-939856764 tempest-VolumeQuotaClassesTest-939856764-project-admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:15.058885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:15.059825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:15.060119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:15.060377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] PATH_INFO: `/v3/users/bce4bd7342f14a55b0d1c257bf91271f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:15.061616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce4bd7342f14a55b0d1c257bf91271f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:15.063592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:15.107525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:15.113860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce4bd7342f14a55b0d1c257bf91271f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.122423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce4bd7342f14a55b0d1c257bf91271f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.135252 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce4bd7342f14a55b0d1c257bf91271f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.136028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce4bd7342f14a55b0d1c257bf91271f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.143571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce4bd7342f14a55b0d1c257bf91271f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.150028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1334/2644] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:14 2022] DELETE /identity/v3/users/bce4bd7342f14a55b0d1c257bf91271f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:15.155257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:15.155770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:15.156031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:15.174153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:15.175528 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:15.239538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1311/2645] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:15.250721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:15.252246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:15.320931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3072-04eb-4a68-8049-9bb26d2b90e6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:15.325379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:15.326081 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:15.326340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:15.326618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:15.337596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:15.339064 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:15.349283 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1335/2646] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:15.644078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:15.654190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:15.667875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297bf4-c63d-4847-a010-6c07766ffadf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:15.674245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:15.675297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:15.675563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:15.676021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] PATH_INFO: `/v3/projects/e34c4dfd621d4280bf264de1e53efbde` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:15.677183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34c4dfd621d4280bf264de1e53efbde)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:15.679207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:15.726857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:15.730540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34c4dfd621d4280bf264de1e53efbde', 'request_id': 'req-8f14f9db-03da-48af-b14b-3cd499a86a80'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.737676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34c4dfd621d4280bf264de1e53efbde', 'request_id': 'req-8f14f9db-03da-48af-b14b-3cd499a86a80'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.747167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34c4dfd621d4280bf264de1e53efbde', 'request_id': 'req-8f14f9db-03da-48af-b14b-3cd499a86a80'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.759970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] The token cache is being invalidate because project e34c4dfd621d4280bf264de1e53efbde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:15.760257 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.761055 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.762616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1312/2647] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:15 2022] DELETE /identity/v3/projects/e34c4dfd621d4280bf264de1e53efbde => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:15.766871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:15.777758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806866ff-8bc3-472b-b2ca-c5fdbbe64b2a service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:15.837616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:15.838526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:15.838914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:15.839214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] PATH_INFO: `/v3/users/1d9757f247f4484fad813b7bff31dbc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:15.840537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9757f247f4484fad813b7bff31dbc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:15.842492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:15.891526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9757f247f4484fad813b7bff31dbc5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.900147 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9757f247f4484fad813b7bff31dbc5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.908005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:15.914284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9757f247f4484fad813b7bff31dbc5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.915034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9757f247f4484fad813b7bff31dbc5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.923050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-827978c4-4393-48a5-8fb8-86aa1b0989c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9757f247f4484fad813b7bff31dbc5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:15.929319 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1336/2648] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:15 2022] DELETE /identity/v3/users/1d9757f247f4484fad813b7bff31dbc5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:16.244227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.245858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:16.264587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f9db-03da-48af-b14b-3cd499a86a80 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.325493 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.326362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.326642 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.326911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] PATH_INFO: `/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.328176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbd1641fe2a49c8b3dc90c686400b87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.330098 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.382758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbd1641fe2a49c8b3dc90c686400b87', 'request_id': 'req-ba0b43c7-a264-44de-8153-38ad6bbf26d9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:16.389184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbd1641fe2a49c8b3dc90c686400b87', 'request_id': 'req-ba0b43c7-a264-44de-8153-38ad6bbf26d9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:16.398433 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbd1641fe2a49c8b3dc90c686400b87', 'request_id': 'req-ba0b43c7-a264-44de-8153-38ad6bbf26d9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:16.412806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] The token cache is being invalidate because project 3fbd1641fe2a49c8b3dc90c686400b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:16.413017 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:16.413748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-ba0b43c7-a264-44de-8153-38ad6bbf26d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:16.415556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1313/2649] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:16 2022] DELETE /identity/v3/projects/3fbd1641fe2a49c8b3dc90c686400b87 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:16.421709 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.422017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.422295 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.441430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:16.442744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:16.510340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1337/2650] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:16.518076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.518362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.518627 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.538930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:16.540243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:16.549138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1314/2651] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:16.553707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.565060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ced46-4b32-4fde-bc5b-3d646818f96f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.570167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.570847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.571126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.571529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.572370 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:16.572841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.574475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.586903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1338/2652] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:32:16.591511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.601047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0fb77-a05b-4ea1-bb53-f495b4639eca None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.605818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.606472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.606754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.607024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.607768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.609680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.638970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1315/2653] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:16 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:16.642921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.653859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e938d-6a3d-4dcb-8dc2-62cbf4660ee6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.710830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.711546 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.711797 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.712210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.712971 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.714914 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.740141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1339/2654] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:16 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:16.744372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.759792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f9f9-5b0b-4bf4-abae-b7c2bcf22845 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.764646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.765324 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.765591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.765863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.766599 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.768377 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.780242 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1316/2655] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:16.785167 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.802855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b35e1-4a49-49f8-8c83-36bf5799cf02 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.810242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.810913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.811199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.811508 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.812241 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.813942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72ef6-5842-4588-8f48-02001158739b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.825340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1340/2656] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:16.831888 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:16.845007 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31715a74-4aee-464d-86ab-6e99ca2fdfb7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:16.850536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:16.851430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.851719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.851993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] PATH_INFO: `/v3/projects/1e9dba35d55d408fbf4ddd10ccfc35aa/users/c544358d1d1d4d00a83d02ba2d1bcbf0/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.868552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9dba35d55d408fbf4ddd10ccfc35aa, user_id=c544358d1d1d4d00a83d02ba2d1bcbf0, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:16.871218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:16.881527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:16.887482 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1317/2657] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:16 2022] PUT /identity/v3/projects/1e9dba35d55d408fbf4ddd10ccfc35aa/users/c544358d1d1d4d00a83d02ba2d1bcbf0/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:16.899356 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:16.899689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:16.899969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:16.933200 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] MFA Rules not processed for user `c544358d1d1d4d00a83d02ba2d1bcbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:16.934449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:16.971621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:17.006624 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1341/2658] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:17.011795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.080849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ad1c-6568-43a2-8257-6f453d07de5a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.086461 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.087333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.087626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.087900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.088646 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.090790 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.123022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1318/2659] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:17 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:17.129402 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.144132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851828d-74ed-42c0-85fc-828f55192039 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.207318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.208026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.208312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.208594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.209298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.211249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.235006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1342/2660] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:17 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:17.239022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.249670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fcaa-7478-4f44-96e2-75ca6e1446a6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.255139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.255868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.256202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.256527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.257307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.259123 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.271141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1319/2661] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:17.277290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.289123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa90de-3596-461e-87ee-4ccb12619ab3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.294988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.295930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.296207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.296478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] PATH_INFO: `/v3/projects/652bb7d4f8d5461d8dca938ba7e41244/users/4e929e904e014dd7939b0a200ccd6339/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.312030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652bb7d4f8d5461d8dca938ba7e41244, user_id=4e929e904e014dd7939b0a200ccd6339, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.314697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.330695 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1343/2662] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:17 2022] PUT /identity/v3/projects/652bb7d4f8d5461d8dca938ba7e41244/users/4e929e904e014dd7939b0a200ccd6339/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:17.334827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.345730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989bf3-ab27-4d7b-9e70-596763433e8c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.409851 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.410538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.410813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.411081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.411841 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.413451 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa3481-cc12-4938-a390-b8de27773a87 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.424495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1320/2663] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:17.430056 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.442908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a3ae-3755-4b9c-8068-2610d09016a7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.448369 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.449365 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.449758 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.450124 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] PATH_INFO: `/v3/projects/652bb7d4f8d5461d8dca938ba7e41244/users/4e929e904e014dd7939b0a200ccd6339/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.452828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=652bb7d4f8d5461d8dca938ba7e41244, user_id=4e929e904e014dd7939b0a200ccd6339, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.455665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.467658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1344/2664] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:17 2022] PUT /identity/v3/projects/652bb7d4f8d5461d8dca938ba7e41244/users/4e929e904e014dd7939b0a200ccd6339/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:17.479483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.479757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.480035 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.514538 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] MFA Rules not processed for user `4e929e904e014dd7939b0a200ccd6339`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:17.516741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:17.582455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:17.594407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1321/2665] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:17.605486 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.607417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:17.670822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7edc93-9a3d-4ecf-a770-1221c5cac81a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.674987 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.675674 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.675957 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.676238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.685833 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.687290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.697123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1345/2666] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:17.750218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:17.752525 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:17.768636 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd36b3-a1af-4459-8e04-726d78f50729 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:17.773248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:17.773896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:17.774177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:17.774446 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:17.833307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:17.834763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7f80-a121-41e6-8eb9-cec4934de727 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:17.852051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1322/2667] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:21.252215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:21.296136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:21.326394 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd0d2e-1470-47a9-87d0-e21cb22f139c service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:21.332188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:21.333111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:21.333378 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:21.333632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] PATH_INFO: `/v3/users/c544358d1d1d4d00a83d02ba2d1bcbf0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:21.335006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c544358d1d1d4d00a83d02ba2d1bcbf0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:21.337020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:21.388685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c544358d1d1d4d00a83d02ba2d1bcbf0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.397318 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c544358d1d1d4d00a83d02ba2d1bcbf0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.409536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c544358d1d1d4d00a83d02ba2d1bcbf0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.410173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c544358d1d1d4d00a83d02ba2d1bcbf0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.416995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c544358d1d1d4d00a83d02ba2d1bcbf0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.422929 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1346/2668] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:21 2022] DELETE /identity/v3/users/c544358d1d1d4d00a83d02ba2d1bcbf0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:21.427762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:21.428261 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:21.428387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:21.446524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:21.447771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:21.515195 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1323/2669] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:21.525547 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:21.528023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:21.590231 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02278a-9ca4-4229-82f6-9afce66581d8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:21.594249 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:21.594903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:21.595182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:21.595601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:21.605874 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:21.607336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:21.617895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1347/2670] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:21.893710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:21.895218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:21.910844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcfe9b-3ee6-416a-9941-075cdcc07254 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:21.916615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:21.917603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:21.917811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:21.918080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] PATH_INFO: `/v3/projects/1e9dba35d55d408fbf4ddd10ccfc35aa` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:21.919415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9dba35d55d408fbf4ddd10ccfc35aa)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:21.921315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:21.975327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9dba35d55d408fbf4ddd10ccfc35aa', 'request_id': 'req-68bb0264-f4ff-4b75-ade8-4d536968a663'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.981664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9dba35d55d408fbf4ddd10ccfc35aa', 'request_id': 'req-68bb0264-f4ff-4b75-ade8-4d536968a663'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:21.990230 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9dba35d55d408fbf4ddd10ccfc35aa', 'request_id': 'req-68bb0264-f4ff-4b75-ade8-4d536968a663'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.000836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] The token cache is being invalidate because project 1e9dba35d55d408fbf4ddd10ccfc35aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:22.001126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.001751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.003359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1324/2671] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:21 2022] DELETE /identity/v3/projects/1e9dba35d55d408fbf4ddd10ccfc35aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:22.007672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:22.018919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e20c-6e50-462d-93dc-9384e4f31299 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:22.069430 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:22.081083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:22.082205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.082520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.082803 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] PATH_INFO: `/v3/users/4e929e904e014dd7939b0a200ccd6339` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.084121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e929e904e014dd7939b0a200ccd6339)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:22.086086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:22.136321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e929e904e014dd7939b0a200ccd6339'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.145282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e929e904e014dd7939b0a200ccd6339'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.164408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e929e904e014dd7939b0a200ccd6339'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.165342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e929e904e014dd7939b0a200ccd6339'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.175456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13eb75e6-ed69-4648-940b-6b6550aa12f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e929e904e014dd7939b0a200ccd6339'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.182535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1348/2672] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:22 2022] DELETE /identity/v3/users/4e929e904e014dd7939b0a200ccd6339 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:22.480722 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:22.482248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:22.497330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb0264-f4ff-4b75-ade8-4d536968a663 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:22.512030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:22.565307 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:22.566408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.566733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.567003 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] PATH_INFO: `/v3/projects/652bb7d4f8d5461d8dca938ba7e41244` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.568479 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652bb7d4f8d5461d8dca938ba7e41244)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:22.570412 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:22.620071 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652bb7d4f8d5461d8dca938ba7e41244', 'request_id': 'req-cc004581-6162-47ff-aae0-12512e0aab09'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.626509 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652bb7d4f8d5461d8dca938ba7e41244', 'request_id': 'req-cc004581-6162-47ff-aae0-12512e0aab09'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.638371 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652bb7d4f8d5461d8dca938ba7e41244', 'request_id': 'req-cc004581-6162-47ff-aae0-12512e0aab09'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.653889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] The token cache is being invalidate because project 652bb7d4f8d5461d8dca938ba7e41244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:22.654277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.655080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cc004581-6162-47ff-aae0-12512e0aab09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:22.656852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1325/2673] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:22 2022] DELETE /identity/v3/projects/652bb7d4f8d5461d8dca938ba7e41244 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:22.662449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.663125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.663125 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.684622 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:22.685816 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:22.753436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1349/2674] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:22.761777 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.762070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.762330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.782613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:22.783875 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:22.792555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1326/2675] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:22.797076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:22.807490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5374-75ee-4220-ae52-4dad6d7ec9cf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:22.812639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:22.813308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.813705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.813895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.814563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:22.814867 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:22.816589 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:22.829757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1350/2676] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:22.834507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:22.844408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67ef7a-93ed-4c72-a471-d3f77b3d748d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:22.849738 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:22.850480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.850771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.851041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.851788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:22.853783 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:22.884664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1327/2677] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:22.889215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:22.899819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd70ee2-3b58-49a6-a6d2-a91945626209 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:22.961078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:22.961762 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:22.962040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:22.962312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:22.963010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:22.965043 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:22.972013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:22.989584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1351/2678] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:22 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:22.995741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:23.006918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebea86-96b5-488f-8f30-3bad289e61ac admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:23.012953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:23.013633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.013916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.014192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:23.014957 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:23.016804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:23.031955 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1328/2679] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:23.033161 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:23.044384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0dd5-d128-4de2-855c-5367172c2f63 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:23.049922 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:23.050601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.050880 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.051299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:23.052094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:23.053694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c997-2f55-4749-9d0f-4c79932c1824 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:23.064731 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1352/2680] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:32:23.069204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:23.080490 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae62cbd-73f9-4f9c-886c-a3d2ccaccde0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:23.085561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:23.086511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.086792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.087069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] PATH_INFO: `/v3/projects/36ca6ddb640d4b069fc419a5d96fcd7e/users/c2fe14acd3d44649928265aff77b4c85/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:23.102963 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ca6ddb640d4b069fc419a5d96fcd7e, user_id=c2fe14acd3d44649928265aff77b4c85, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:23.105679 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:23.120452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1329/2681] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:23 2022] PUT /identity/v3/projects/36ca6ddb640d4b069fc419a5d96fcd7e/users/c2fe14acd3d44649928265aff77b4c85/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:23.125811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fce46-b8cf-489d-a90c-054367eef42d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.126131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fce46-b8cf-489d-a90c-054367eef42d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.126410 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fce46-b8cf-489d-a90c-054367eef42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:23.145536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a66fce46-b8cf-489d-a90c-054367eef42d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:23.146786 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a66fce46-b8cf-489d-a90c-054367eef42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:23.210962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1353/2682] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:23.220569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:23.222288 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:23.272810 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:23.285856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456e57-2d33-4f47-b024-95bfd00e7b87 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:23.290260 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:23.290921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.291201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.291544 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:23.301666 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:23.303149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:23.317587 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1330/2683] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:32:23.986637 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:23.987168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:23.987168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.015712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] MFA Rules not processed for user `c2fe14acd3d44649928265aff77b4c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:24.016931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:24.098251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1354/2684] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:24.102719 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.113178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920af0-7666-43fe-b042-d78486097070 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.118554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52878688-9b14-4105-9d48-af961399064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.119216 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878688-9b14-4105-9d48-af961399064a admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.119540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878688-9b14-4105-9d48-af961399064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.120149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878688-9b14-4105-9d48-af961399064a admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.120865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52878688-9b14-4105-9d48-af961399064a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.122818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52878688-9b14-4105-9d48-af961399064a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.155595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1331/2685] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:24 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:24.157279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.170300 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aeb8e-a4f7-4537-9b96-2848381fe6b1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.230730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.231426 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.231712 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.231999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.232683 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.234621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.252490 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:24.260974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1355/2686] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:24 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:24.265791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52878688-9b14-4105-9d48-af961399064a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.280096 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52878688-9b14-4105-9d48-af961399064a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.285789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.286455 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.286732 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.287000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.287749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.289386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.302465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1332/2687] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:24.307533 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.324500 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2fcfc-3726-4fd4-88f2-819e6837ea5f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.330605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.331697 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.331985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.332262 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] PATH_INFO: `/v3/projects/f14efb570c7245b29f0c4012ffc2200f/users/69c2880d41d34fd1a5b627ad4f376774/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.349636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14efb570c7245b29f0c4012ffc2200f, user_id=69c2880d41d34fd1a5b627ad4f376774, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.352742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.367933 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1356/2688] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:24 2022] PUT /identity/v3/projects/f14efb570c7245b29f0c4012ffc2200f/users/69c2880d41d34fd1a5b627ad4f376774/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:24.372220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.382890 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771bd99-d7a3-4984-b002-6d90d28ae4ad admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.446016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.446813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.447097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.447405 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.448175 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.449829 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426438-d5b3-4ff6-98f0-624e48616070 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.465652 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1333/2689] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:24.467802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:24.481452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea05-bfbd-452d-8d22-7f1690833045 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:24.486308 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:24.487205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:24.487515 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:24.487789 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] PATH_INFO: `/v3/projects/f14efb570c7245b29f0c4012ffc2200f/users/69c2880d41d34fd1a5b627ad4f376774/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:24.489849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14efb570c7245b29f0c4012ffc2200f, user_id=69c2880d41d34fd1a5b627ad4f376774, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:24.492550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeb837-e4f1-40a5-a671-692e7cd34ebf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:24.503966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1357/2690] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:24 2022] PUT /identity/v3/projects/f14efb570c7245b29f0c4012ffc2200f/users/69c2880d41d34fd1a5b627ad4f376774/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:25.831879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:25.832341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:25.832428 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:25.873044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] MFA Rules not processed for user `69c2880d41d34fd1a5b627ad4f376774`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:25.875065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:25.967282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1334/2691] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:25.978652 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:25.979103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:25.979103 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:25.999219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] MFA Rules not processed for user `c2fe14acd3d44649928265aff77b4c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:26.000499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:26.070069 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1358/2692] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:26.081620 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:26.082977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:26.128934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:26.179136 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2cc36-5513-46f7-844f-63ff788008ea None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:26.186484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:26.187161 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:26.187504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:26.187785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:26.202958 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:26.204731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:26.214765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1335/2693] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:32.459569 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:32.522930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01287e4-6328-477f-8112-7488e5fbdf1d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:32.527605 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:32.528351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:32.528730 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:32.529080 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:32.535738 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:32.605859 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:32.607478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:32.618960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1359/2694] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:36.028254 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.029770 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:36.045352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cdcd9-c41a-4ae1-bf94-b07912a989c9 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.050236 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.051091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.051404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.051677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] PATH_INFO: `/v3/users/ef28fef252ed4dcfb7815b4150a18cbe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.052991 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef28fef252ed4dcfb7815b4150a18cbe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.054934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:36.120650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef28fef252ed4dcfb7815b4150a18cbe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.129621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef28fef252ed4dcfb7815b4150a18cbe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.138629 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef28fef252ed4dcfb7815b4150a18cbe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.139281 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef28fef252ed4dcfb7815b4150a18cbe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.139967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-558ae24d-7175-4195-a1d5-8f57b75d8402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef28fef252ed4dcfb7815b4150a18cbe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.158132 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1336/2695] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:36 2022] DELETE /identity/v3/users/ef28fef252ed4dcfb7815b4150a18cbe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:36.432188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.443361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527e84-a91d-4ffe-9832-9293b373ecad service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.468279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:36.519583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.520471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.520754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.521041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] PATH_INFO: `/v3/projects/7ec0b458db8e40c7aa308a882949c77a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.522396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec0b458db8e40c7aa308a882949c77a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.524380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:36.581691 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec0b458db8e40c7aa308a882949c77a', 'request_id': 'req-6ec1898c-99bc-4308-bd28-f9165fb5f533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.589083 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec0b458db8e40c7aa308a882949c77a', 'request_id': 'req-6ec1898c-99bc-4308-bd28-f9165fb5f533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.596376 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec0b458db8e40c7aa308a882949c77a', 'request_id': 'req-6ec1898c-99bc-4308-bd28-f9165fb5f533'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.607909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] The token cache is being invalidate because project 7ec0b458db8e40c7aa308a882949c77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:36.608157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.608812 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ec1898c-99bc-4308-bd28-f9165fb5f533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:36.610467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1360/2696] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:36 2022] DELETE /identity/v3/projects/7ec0b458db8e40c7aa308a882949c77a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:36.615586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.615869 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.616147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.640977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:36.642205 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:36.726048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1337/2697] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:36.734182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.734509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.734831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.754743 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:36.756084 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:36.764606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1361/2698] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:36.769430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.782383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30f7a8-5cc9-47a8-8c63-9efc10505110 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.787321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.788046 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.788336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.788625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.789385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:36.789694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.791476 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:36.803867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1338/2699] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:36.808457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.818815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27327b3d-decb-4864-9c0b-8be61c1cd602 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.824199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.824856 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.825145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.825401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.826102 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.828072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:36.857703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1362/2700] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:36 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:36.862088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.872997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ba84-49ae-4855-86a4-4da524015e80 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.892304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:36.936898 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.937728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.938061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.938384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.939088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.941151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:36.964754 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1339/2701] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:36 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:36.969636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:36.981068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5ff9a-a44f-483f-8917-df8c5a06f142 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:36.987027 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:36.987745 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:36.988026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:36.988312 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:36.989013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:36.990682 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.002595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1363/2702] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:37.007056 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.018088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d920c-02f9-47c3-a50c-88ce0572f127 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.023825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.024489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.024763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.025030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.025780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.027913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35a56e-4276-41d1-a54d-c0df426d215f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.038876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1340/2703] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:32:37.043805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.054808 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac2d7-0166-418d-8ee6-17a4e36c01c6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.059913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.060834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.061138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.061414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] PATH_INFO: `/v3/projects/d6720787c7f14fc39415a9e34d7b5872/users/35401de6ee864a83a5e0b536c6d0875c/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.076656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6720787c7f14fc39415a9e34d7b5872, user_id=35401de6ee864a83a5e0b536c6d0875c, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.079432 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.094973 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1364/2704] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:37 2022] PUT /identity/v3/projects/d6720787c7f14fc39415a9e34d7b5872/users/35401de6ee864a83a5e0b536c6d0875c/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:37.100369 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.100696 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.100972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.120068 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:37.121336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:37.187378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1341/2705] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:37.198923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.201222 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:37.249834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:37.265118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17f32-c1c7-40a9-b338-35ec282dc8a9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.269471 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.270156 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.270465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.270741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.281615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.283117 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d90463-e20c-44ee-9265-d2c806da7995 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.293596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1365/2706] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:38.114013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.115584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.142838 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.143408 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.143513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.181021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] MFA Rules not processed for user `35401de6ee864a83a5e0b536c6d0875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:38.182379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa32d-468a-4740-837c-3e5cfb34e5da None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.182675 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.186552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.187224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.187735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.188121 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.191064 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.273094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1366/2707] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:38.278453 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.280329 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:38.291654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75228-e917-449f-98e3-87e3e958d2ef None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.296188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.296588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.297620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.297873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.297995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.298298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.299072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.301144 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.309874 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1342/2708] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:38.342330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1367/2709] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:38.346662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.359524 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02425b-3c7a-4ed2-949b-987d83f2871a service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.436305 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.436905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.437182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.437466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.438250 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.440297 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.462202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1343/2710] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/users => generated 308 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:38.466087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.476606 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ff14-b95f-4287-a5e2-8de6e1df5a58 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.481580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.482314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.482441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.482718 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.483481 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.485189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.499764 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1368/2711] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:38.501122 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.511857 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93d39-9190-4a75-b4bb-722db34d9105 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.516551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.517486 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.517764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.518032 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] PATH_INFO: `/v3/projects/da96199d17d24b069cf07c63cb18060a/users/cf985f157a8b47de8146f08fb24a7c6f/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.535082 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da96199d17d24b069cf07c63cb18060a, user_id=cf985f157a8b47de8146f08fb24a7c6f, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.537945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.551581 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1344/2712] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:38 2022] PUT /identity/v3/projects/da96199d17d24b069cf07c63cb18060a/users/cf985f157a8b47de8146f08fb24a7c6f/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:38.555715 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.566037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f072-fefc-4cb2-8702-bffe5f97e520 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.625051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.625726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.626008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.626282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.627188 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.628734 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60234-709a-47a2-913f-353fd439cbc0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.640163 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1369/2713] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:38.644836 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.656526 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499382e-94eb-47a5-98b0-bb3506da8b65 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.661870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.662775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.663053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.663430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] PATH_INFO: `/v3/projects/da96199d17d24b069cf07c63cb18060a/users/cf985f157a8b47de8146f08fb24a7c6f/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.665521 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da96199d17d24b069cf07c63cb18060a, user_id=cf985f157a8b47de8146f08fb24a7c6f, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.668262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186320ab-1b03-42db-8720-adf6fb1aeb04 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.680436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1345/2714] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:38 2022] PUT /identity/v3/projects/da96199d17d24b069cf07c63cb18060a/users/cf985f157a8b47de8146f08fb24a7c6f/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:39.394827 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d91a2f-1979-4082-b2eb-d62c59e78746 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.395513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d91a2f-1979-4082-b2eb-d62c59e78746 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.395513 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d91a2f-1979-4082-b2eb-d62c59e78746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.427255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d8d91a2f-1979-4082-b2eb-d62c59e78746 None None] MFA Rules not processed for user `cf985f157a8b47de8146f08fb24a7c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:39.428991 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8d91a2f-1979-4082-b2eb-d62c59e78746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:39.458219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:39.503451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1370/2715] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:40.118962 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:40.119584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:40.119584 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:40.121245 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1346/2716] 10.222.0.82 () {54 vars in 921 bytes} [Wed Jul 20 19:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:32:40.134270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:40.134564 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:40.134842 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:40.154351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] MFA Rules not processed for user `a77e20517c584bc0bd7df627d805467b`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:40.155592 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:40.234061 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1371/2717] 10.222.0.82 () {58 vars in 1018 bytes} [Wed Jul 20 19:32:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:40.246999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:40.249406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:40.268037 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f32f49-6d23-4d8a-9f65-2a7728ca84c4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:40.273162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:40.273927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:40.274304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:40.274667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:40.284751 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:40.286667 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:40.298917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1347/2718] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:40.785883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:40.853441 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc83d-69ee-4b05-a6a5-597e7cee5035 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:40.858793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:40.859800 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:40.860029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:40.860302 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] PATH_INFO: `/v3/users/35401de6ee864a83a5e0b536c6d0875c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:40.861518 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=35401de6ee864a83a5e0b536c6d0875c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:40.863510 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:40.913961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35401de6ee864a83a5e0b536c6d0875c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:40.923411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35401de6ee864a83a5e0b536c6d0875c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:40.929215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:40.938062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35401de6ee864a83a5e0b536c6d0875c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:40.939297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35401de6ee864a83a5e0b536c6d0875c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:40.946517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35401de6ee864a83a5e0b536c6d0875c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:40.953573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1372/2719] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:40 2022] DELETE /identity/v3/users/35401de6ee864a83a5e0b536c6d0875c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:41.180311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:41.192183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b1c5e-918b-4925-9851-3e2f56a3fff6 service placement] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:41.255020 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:41.256709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:41.256993 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:41.257269 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] PATH_INFO: `/v3/projects/d6720787c7f14fc39415a9e34d7b5872` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:41.258555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6720787c7f14fc39415a9e34d7b5872)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:41.260534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:41.298908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:41.317475 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6720787c7f14fc39415a9e34d7b5872', 'request_id': 'req-86990fb7-2120-4a09-b29c-a368bf2b9d28'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.324059 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6720787c7f14fc39415a9e34d7b5872', 'request_id': 'req-86990fb7-2120-4a09-b29c-a368bf2b9d28'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.332418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6720787c7f14fc39415a9e34d7b5872', 'request_id': 'req-86990fb7-2120-4a09-b29c-a368bf2b9d28'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.342859 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] The token cache is being invalidate because project d6720787c7f14fc39415a9e34d7b5872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:41.343149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.343928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.345494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1348/2720] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:41 2022] DELETE /identity/v3/projects/d6720787c7f14fc39415a9e34d7b5872 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:41.349687 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:41.351105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:41.364263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583091f5-593c-45da-adff-031bd2dae2be admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:41.422437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:41.423352 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:41.423645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:41.423926 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] PATH_INFO: `/v3/users/cf985f157a8b47de8146f08fb24a7c6f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:41.425189 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf985f157a8b47de8146f08fb24a7c6f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:41.427160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:41.479342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf985f157a8b47de8146f08fb24a7c6f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.487296 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf985f157a8b47de8146f08fb24a7c6f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.500414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf985f157a8b47de8146f08fb24a7c6f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.501038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf985f157a8b47de8146f08fb24a7c6f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.508562 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-28247d2f-b9f3-4dcf-b853-604356a3cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf985f157a8b47de8146f08fb24a7c6f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.515783 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1373/2721] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:41 2022] DELETE /identity/v3/users/cf985f157a8b47de8146f08fb24a7c6f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:41.733580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:41.736031 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:41.752464 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86990fb7-2120-4a09-b29c-a368bf2b9d28 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:41.815582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:41.816466 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:41.816750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:41.817018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] PATH_INFO: `/v3/projects/da96199d17d24b069cf07c63cb18060a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:41.818415 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da96199d17d24b069cf07c63cb18060a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:41.820424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:41.873603 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da96199d17d24b069cf07c63cb18060a', 'request_id': 'req-4c5e304c-e181-45c0-97e6-c91086af71e9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.880443 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da96199d17d24b069cf07c63cb18060a', 'request_id': 'req-4c5e304c-e181-45c0-97e6-c91086af71e9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.889742 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da96199d17d24b069cf07c63cb18060a', 'request_id': 'req-4c5e304c-e181-45c0-97e6-c91086af71e9'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.901332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] The token cache is being invalidate because project da96199d17d24b069cf07c63cb18060a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:41.901615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.902585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-4c5e304c-e181-45c0-97e6-c91086af71e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:41.904246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1349/2722] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:41 2022] DELETE /identity/v3/projects/da96199d17d24b069cf07c63cb18060a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:41.909594 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:41.910104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:41.910104 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:41.929173 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:41.930419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:41.981406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:41.993006 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1374/2723] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:42.000983 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.001273 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.001549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.021896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:42.023143 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:42.032717 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1350/2724] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:42.037585 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.048406 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8941e7-ff69-405c-8ca8-808a3e634876 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.056205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.057227 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.057639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.058062 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.059099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:42.059527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.062038 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.075454 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1375/2725] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:42.080565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.094980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a4e1-1962-4f8f-9609-6491859aff7c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.101106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.101845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.102130 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.102400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.103111 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.105114 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.135961 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1351/2726] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:42 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:42.140326 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.150826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4538c9-bf75-417c-bd79-75f0c8ea054e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.223293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.224011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.224292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.224567 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.225271 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.227268 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.250026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1376/2727] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:42 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:42.259730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.271244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4db9-d632-4422-bdcb-c2a394d80863 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.276615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.277664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.277945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.278217 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.279004 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.280695 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.292026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1352/2728] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:42.296554 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.307133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb484c2-e792-4f42-89ad-3ab69fa5a566 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.312851 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.313520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.313828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.314105 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.314843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.316536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3241c-5572-4c46-bcd2-569449089b68 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.327240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1377/2729] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:42.331671 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.342845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01c44-adf5-464a-9ab7-f92be9a07118 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.348331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.349238 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.349516 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.349785 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] PATH_INFO: `/v3/projects/734128f527fa43088ce7cc3f36ccd8bf/users/50213115f58c40da9481c161f10b4248/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.353406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:42.368403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=734128f527fa43088ce7cc3f36ccd8bf, user_id=50213115f58c40da9481c161f10b4248, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.371076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.388750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1353/2730] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:42 2022] PUT /identity/v3/projects/734128f527fa43088ce7cc3f36ccd8bf/users/50213115f58c40da9481c161f10b4248/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:42.402412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.402704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.402983 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.430278 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] MFA Rules not processed for user `50213115f58c40da9481c161f10b4248`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:42.431493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:42.503771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1378/2731] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:42.510502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.597237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258288-e601-4a1f-9e99-0060f808aaaf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.602534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.603220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.603507 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.603791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.604487 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.606421 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.634460 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1354/2732] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:42.638840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.650820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff049df1-554e-45ef-be75-5e7ac5831026 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.703070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:42.717154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.717982 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.718708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.718708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.719512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.721794 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.757066 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1379/2733] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:42 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:42.761568 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.772572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951968-aff9-4dde-a7d8-7df9aa48795f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.778709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.779621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.779903 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.780191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.780945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.782578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.799452 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1355/2734] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:42.800459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.811251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352379-4a5c-410e-8ccd-b798f1924c99 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.816284 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.817506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.817781 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.818138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] PATH_INFO: `/v3/projects/906b120ea56d48d4a83a4d0dd113825e/users/dac2f0afb10a47fa998b24fce1976c0f/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.837362 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=906b120ea56d48d4a83a4d0dd113825e, user_id=dac2f0afb10a47fa998b24fce1976c0f, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.840239 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.855469 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1380/2735] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:42 2022] PUT /identity/v3/projects/906b120ea56d48d4a83a4d0dd113825e/users/dac2f0afb10a47fa998b24fce1976c0f/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:42.859504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.869703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c27fd-becc-4901-b034-f8970ee555cc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.930502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.931185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.931501 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.931779 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.932689 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.934495 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e7361-1e93-4db5-ae2c-59e94ee8ce3e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:42.948633 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1356/2736] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:42.950023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:42.963253 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127d96-6144-43ba-b339-2c9984660fbc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:42.970047 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:42.971053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:42.971429 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:42.971860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] PATH_INFO: `/v3/projects/906b120ea56d48d4a83a4d0dd113825e/users/dac2f0afb10a47fa998b24fce1976c0f/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:42.974579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906b120ea56d48d4a83a4d0dd113825e, user_id=dac2f0afb10a47fa998b24fce1976c0f, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:42.977998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:43.004019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1381/2737] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:42 2022] PUT /identity/v3/projects/906b120ea56d48d4a83a4d0dd113825e/users/dac2f0afb10a47fa998b24fce1976c0f/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:43.017994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:43.018426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:43.018791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:43.057480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] MFA Rules not processed for user `dac2f0afb10a47fa998b24fce1976c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:43.058974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:43.109206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:43.136735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1357/2738] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:43.150400 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:43.152704 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:43.215516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed7cc-181c-413d-be9d-46b560d3e792 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:43.219343 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:43.220010 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:43.220294 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:43.220570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:43.230310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:43.231852 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:43.241491 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1382/2739] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:43.320168 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:43.330426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7af8c-36f0-42dd-a079-64c0e3db9cb5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:43.334593 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:43.335255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:43.335579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:43.335855 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:43.404112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:43.405634 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea655e2-4c5c-48eb-a5d9-ec683929b4e9 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:43.415660 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1358/2740] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:50.345699 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:50.457869 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939b31-559b-4933-b1bd-0a14d9d230c9 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:50.462877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:50.463826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:50.464111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:50.464389 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] PATH_INFO: `/v3/users/50213115f58c40da9481c161f10b4248` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:50.465639 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50213115f58c40da9481c161f10b4248)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:50.467615 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:50.473344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:50.515390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50213115f58c40da9481c161f10b4248'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:50.523793 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50213115f58c40da9481c161f10b4248'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:50.538825 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50213115f58c40da9481c161f10b4248'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:50.539664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50213115f58c40da9481c161f10b4248'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:50.546836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50213115f58c40da9481c161f10b4248'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:50.553118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1383/2741] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:50 2022] DELETE /identity/v3/users/50213115f58c40da9481c161f10b4248 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:50.558021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:50.558529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:50.558647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:50.609091 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:50.610325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:50.673688 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1359/2742] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:50.683647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:50.685148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:50.763336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f61f6-9719-45bb-ad73-8507e6275466 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:50.767787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:50.768464 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:50.768753 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:50.769136 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:50.779506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:50.781122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:50.791596 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1384/2743] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:51.088797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.090597 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.108341 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43892874-07ab-4a44-bad6-b09e9d0e9b2b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.116141 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.118148 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.118430 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.118716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] PATH_INFO: `/v3/projects/734128f527fa43088ce7cc3f36ccd8bf` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.120080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734128f527fa43088ce7cc3f36ccd8bf)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.122359 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.173792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:51.175733 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734128f527fa43088ce7cc3f36ccd8bf', 'request_id': 'req-f547abf2-ee26-4c8d-8666-f5a558ac1367'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.183582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734128f527fa43088ce7cc3f36ccd8bf', 'request_id': 'req-f547abf2-ee26-4c8d-8666-f5a558ac1367'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.193060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734128f527fa43088ce7cc3f36ccd8bf', 'request_id': 'req-f547abf2-ee26-4c8d-8666-f5a558ac1367'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.205840 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] The token cache is being invalidate because project 734128f527fa43088ce7cc3f36ccd8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:51.206139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.207403 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.208762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1360/2744] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:51 2022] DELETE /identity/v3/projects/734128f527fa43088ce7cc3f36ccd8bf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:51.213087 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.223817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2960-8c40-4545-af5c-3737de2237c2 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.286198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.287011 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.287299 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.287604 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] PATH_INFO: `/v3/users/dac2f0afb10a47fa998b24fce1976c0f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.288882 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac2f0afb10a47fa998b24fce1976c0f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.290876 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.305766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:51.339248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac2f0afb10a47fa998b24fce1976c0f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.348225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac2f0afb10a47fa998b24fce1976c0f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.360834 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac2f0afb10a47fa998b24fce1976c0f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.361570 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac2f0afb10a47fa998b24fce1976c0f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.368761 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13e7785d-c4e1-484c-a4fc-8ccb0200ce83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac2f0afb10a47fa998b24fce1976c0f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.374780 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1385/2745] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:51 2022] DELETE /identity/v3/users/dac2f0afb10a47fa998b24fce1976c0f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:51.669555 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.671585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.687897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547abf2-ee26-4c8d-8666-f5a558ac1367 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.751548 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.752330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.752614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.752885 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] PATH_INFO: `/v3/projects/906b120ea56d48d4a83a4d0dd113825e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.754104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=906b120ea56d48d4a83a4d0dd113825e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.756072 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.807365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906b120ea56d48d4a83a4d0dd113825e', 'request_id': 'req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.813417 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906b120ea56d48d4a83a4d0dd113825e', 'request_id': 'req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.822485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906b120ea56d48d4a83a4d0dd113825e', 'request_id': 'req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.838209 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] The token cache is being invalidate because project 906b120ea56d48d4a83a4d0dd113825e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:51.838565 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.839737 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-8b555acf-ceda-4cb9-aabd-2ab812d6a33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:51.842270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1361/2746] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:51 2022] DELETE /identity/v3/projects/906b120ea56d48d4a83a4d0dd113825e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:51.850506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.850817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.851197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.910658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:51.911908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.981287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1386/2747] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:51.988153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.988519 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.988852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.008856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:52.010184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:52.026500 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1362/2748] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:52.031211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.041345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65009e-0b62-4f4b-8a15-0800c0415092 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.046620 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.047417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.047792 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.048134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.049008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:52.049383 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.051089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.067525 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1387/2749] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:52.068782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.078333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5c3e0-3b27-4f3d-8ad5-6e31cc940ac7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.082936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.083622 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.083895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.084185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.084867 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.086800 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.113531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1363/2750] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:52.118583 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.129864 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242a725-9409-4e9a-b36e-894a17d15b6c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.186423 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:52.193993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.194850 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.195139 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.195836 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.196855 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.198902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.219710 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1388/2751] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:52.224086 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.236333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c7cd-31a4-4e6d-aa79-8dcd3386db9d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.243109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.244025 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.244424 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.244771 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.245748 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.247889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.261928 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1364/2752] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:52.266545 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.278137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb7de8-91c8-4831-91cd-bad4b000313d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.284179 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.284857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.285141 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.285419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.286154 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.287865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bccfa2-98f6-480f-8746-c1363934223b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.301910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1389/2753] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:52.306321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.317602 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56ad8-4c6a-46b0-ad56-0100eec70c2f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.323235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.324262 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.324625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.325002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] PATH_INFO: `/v3/projects/5934bb7b7489440c96bd9c835c85eb2f/users/a37074351f8e499b8c13cf2367d6ea16/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.341664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5934bb7b7489440c96bd9c835c85eb2f, user_id=a37074351f8e499b8c13cf2367d6ea16, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.344365 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.359448 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1365/2754] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:52 2022] PUT /identity/v3/projects/5934bb7b7489440c96bd9c835c85eb2f/users/a37074351f8e499b8c13cf2367d6ea16/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:52.371705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.371705 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.372155 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.400647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] MFA Rules not processed for user `a37074351f8e499b8c13cf2367d6ea16`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:52.402358 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:52.470205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1390/2755] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:52.474807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.479499 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:52.543816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f9655-5b89-41ce-8101-5f978f3c162f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.548514 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.549177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.549453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.549757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.550462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.552425 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.583670 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1366/2756] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:52.589000 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.602371 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a1e83-3441-4237-88e0-932bf4b917ad None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.677281 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.678070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.678338 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.678613 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.679442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.681386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.702679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1391/2757] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:52.707047 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.717776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4558-b3bf-48f8-bf40-9fad63d5cdf8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.722825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.723626 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.723998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.724366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.725187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.726915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.739613 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1367/2758] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:52.744204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.754602 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f855281-69e4-4d1f-81bb-b45288b25fe5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.759387 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.760285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.760560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.760830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] PATH_INFO: `/v3/projects/3bee85ddb0ca41d99d44c5b17e718649/users/565008933ebd44e393ca7b583e396c3e/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.777215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bee85ddb0ca41d99d44c5b17e718649, user_id=565008933ebd44e393ca7b583e396c3e, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.780034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.795462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1392/2759] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:52 2022] PUT /identity/v3/projects/3bee85ddb0ca41d99d44c5b17e718649/users/565008933ebd44e393ca7b583e396c3e/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:52.799749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.811078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac001-9993-4bf8-89e5-e4cefe29b3ce admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.877540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.878112 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.878387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.878656 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.879404 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.881001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3fbd-c5bd-4383-a1c9-4927c57b7fea admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.890913 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1368/2760] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:52.895203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.906251 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f8aa7-38da-4038-af56-96b056394ab2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.911186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.912209 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.912566 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.912716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] PATH_INFO: `/v3/projects/3bee85ddb0ca41d99d44c5b17e718649/users/565008933ebd44e393ca7b583e396c3e/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.915520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bee85ddb0ca41d99d44c5b17e718649, user_id=565008933ebd44e393ca7b583e396c3e, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.918325 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.930093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1393/2761] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:52 2022] PUT /identity/v3/projects/3bee85ddb0ca41d99d44c5b17e718649/users/565008933ebd44e393ca7b583e396c3e/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:52.940520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.940812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.941089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.967873 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] MFA Rules not processed for user `565008933ebd44e393ca7b583e396c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:52.969079 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:53.043002 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.049641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1369/2762] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:53.061385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.063273 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:53.082974 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.125919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd9a0e-303c-4b49-934f-6060f0fe5a00 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.130225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.130810 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.131089 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.131366 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.141493 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.142942 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.153235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1394/2763] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:53.231026 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.241554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf3e6a-ae5e-4f4d-9e0b-9d61d839f286 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.245432 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.246187 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.246564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.246909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.308518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.310207 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.321095 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1370/2764] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:58.840580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:58.842348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:58.916067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6717d4-6599-41b5-816a-d26180ee147b service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:58.921303 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:58.922194 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.922478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.922752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] PATH_INFO: `/v3/users/c2fe14acd3d44649928265aff77b4c85` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.923989 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fe14acd3d44649928265aff77b4c85)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:58.926039 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.974293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fe14acd3d44649928265aff77b4c85'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:58.984990 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fe14acd3d44649928265aff77b4c85'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:58.998473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fe14acd3d44649928265aff77b4c85'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:58.999203 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fe14acd3d44649928265aff77b4c85'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.006703 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fe14acd3d44649928265aff77b4c85'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.012847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1395/2765] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:58 2022] DELETE /identity/v3/users/c2fe14acd3d44649928265aff77b4c85 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:59.216024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:59.230784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9a86-53fe-4b03-8228-e12e8b8fa59e service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:59.299970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:59.300847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:59.301131 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:59.301402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] PATH_INFO: `/v3/projects/36ca6ddb640d4b069fc419a5d96fcd7e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:59.302716 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ca6ddb640d4b069fc419a5d96fcd7e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:59.304691 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:59.362745 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ca6ddb640d4b069fc419a5d96fcd7e', 'request_id': 'req-83161ca9-1b8b-451b-be26-de565ac9682b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.370709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ca6ddb640d4b069fc419a5d96fcd7e', 'request_id': 'req-83161ca9-1b8b-451b-be26-de565ac9682b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.381858 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ca6ddb640d4b069fc419a5d96fcd7e', 'request_id': 'req-83161ca9-1b8b-451b-be26-de565ac9682b'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.392664 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] The token cache is being invalidate because project 36ca6ddb640d4b069fc419a5d96fcd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:59.392975 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.393741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.395339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1371/2766] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:59 2022] DELETE /identity/v3/projects/36ca6ddb640d4b069fc419a5d96fcd7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:59.399451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:59.402701 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:59.418956 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6728-11a4-4686-a7ef-7e8834d4346b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:59.453021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:59.480388 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:59.481315 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:59.481549 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:59.481823 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] PATH_INFO: `/v3/users/69c2880d41d34fd1a5b627ad4f376774` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:59.483199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c2880d41d34fd1a5b627ad4f376774)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:59.485205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:59.543895 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c2880d41d34fd1a5b627ad4f376774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.553094 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c2880d41d34fd1a5b627ad4f376774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.567438 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c2880d41d34fd1a5b627ad4f376774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.568391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c2880d41d34fd1a5b627ad4f376774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.575588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c7a6e8c-f3b6-4a76-ba37-b10e719b8c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c2880d41d34fd1a5b627ad4f376774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.582345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1396/2767] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:59 2022] DELETE /identity/v3/users/69c2880d41d34fd1a5b627ad4f376774 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:59.781793 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:59.783812 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:59.798563 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161ca9-1b8b-451b-be26-de565ac9682b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:59.830379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:59.869270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:59.870153 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:59.870434 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:59.870709 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] PATH_INFO: `/v3/projects/f14efb570c7245b29f0c4012ffc2200f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:59.871949 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14efb570c7245b29f0c4012ffc2200f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:59.873889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:59.924202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14efb570c7245b29f0c4012ffc2200f', 'request_id': 'req-6c1558b6-967e-477b-8c34-8269aff25f70'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.931838 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14efb570c7245b29f0c4012ffc2200f', 'request_id': 'req-6c1558b6-967e-477b-8c34-8269aff25f70'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.940729 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14efb570c7245b29f0c4012ffc2200f', 'request_id': 'req-6c1558b6-967e-477b-8c34-8269aff25f70'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.951799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] The token cache is being invalidate because project f14efb570c7245b29f0c4012ffc2200f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:59.952084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.952710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6c1558b6-967e-477b-8c34-8269aff25f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:59.954301 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1372/2768] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:59 2022] DELETE /identity/v3/projects/f14efb570c7245b29f0c4012ffc2200f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:59.959398 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:59.959903 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:59.959998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:59.979072 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:59.980243 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:00.042042 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1397/2769] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:00.050332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.050621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.050915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.072856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:00.074789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:00.086034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1373/2770] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:00.091115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.104662 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec455d-135b-4f1c-9882-0da2939ce84b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.109979 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.110737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.111053 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.111361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.112148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:00.112456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.114067 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.126168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1398/2771] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:00.131109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.145938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c422-9135-4860-a038-ac23a8250fa5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.152616 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.153270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.153550 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.153804 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.154498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.156556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.191263 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1374/2772] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:00 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:00.195399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.206120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87525d4-7ecf-4204-8314-7e64178e7f70 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.253988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:00.277686 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.278377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.278770 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.279018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.279766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.281739 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.305100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1399/2773] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:00 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:00.309782 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.322407 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a59a-7901-4eb7-ae50-5aed1fe1cdbb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.327981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.328690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.328966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.329246 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.330011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.331714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.343755 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1375/2774] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:33:00.348321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.359451 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2124f-1854-434d-bad3-8c9e226ffa9b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.364726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.365442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.365729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.366008 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.366916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.368634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fcbd7-8c0b-4518-834b-94995aeddfdc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.379470 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1400/2775] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:00.384339 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.395237 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc3eb9-1554-4763-a102-82cd309d0488 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.400352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.401311 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.401984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.402270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] PATH_INFO: `/v3/projects/41f530c802c1453cafa3d353337e2a57/users/f92eeb311c3347ceb4d42e7de40737ee/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.418744 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f530c802c1453cafa3d353337e2a57, user_id=f92eeb311c3347ceb4d42e7de40737ee, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.421579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.437801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1376/2776] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:00 2022] PUT /identity/v3/projects/41f530c802c1453cafa3d353337e2a57/users/f92eeb311c3347ceb4d42e7de40737ee/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:33:00.449131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.449439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.449737 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.480689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] MFA Rules not processed for user `f92eeb311c3347ceb4d42e7de40737ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:00.482033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:00.552555 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1401/2777] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:00.564657 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.566515 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:00.633244 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe7dad-2618-4884-893a-ccabb32492b2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.637402 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.638060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.638343 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.638618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.645878 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:00.649196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.651067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a145604-cb70-4118-8527-40570d55cf23 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:00.663936 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1377/2778] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:00.864694 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:00.866245 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:00.937863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f196c-6afa-430b-b41b-cd1a6ee53305 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:00.943101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:00.943924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:00.951977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:00.951977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] PATH_INFO: `/v3/users/a37074351f8e499b8c13cf2367d6ea16` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:00.951977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37074351f8e499b8c13cf2367d6ea16)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:00.951977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:01.008511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37074351f8e499b8c13cf2367d6ea16'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.018333 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37074351f8e499b8c13cf2367d6ea16'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.019653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:01.034457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37074351f8e499b8c13cf2367d6ea16'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.035204 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37074351f8e499b8c13cf2367d6ea16'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.042785 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37074351f8e499b8c13cf2367d6ea16'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.049575 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1402/2779] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:00 2022] DELETE /identity/v3/users/a37074351f8e499b8c13cf2367d6ea16 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:01.054739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:01.055024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:01.055292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:01.077227 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:01.078559 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:01.155472 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1378/2780] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:01.169544 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:01.171877 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:01.238967 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07523a4-2cc6-400e-91e2-f2adb7015366 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:01.243923 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:01.244578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:01.244909 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:01.245184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:01.255999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:01.257707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:01.267790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1403/2781] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:01.559905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:01.561543 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:01.575897 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d015460-a4b5-48f5-aa94-ed049ea0d57e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:01.581332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:01.582410 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:01.582700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:01.582987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] PATH_INFO: `/v3/projects/5934bb7b7489440c96bd9c835c85eb2f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:01.584397 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5934bb7b7489440c96bd9c835c85eb2f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:01.586373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:01.634693 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5934bb7b7489440c96bd9c835c85eb2f', 'request_id': 'req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.640918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5934bb7b7489440c96bd9c835c85eb2f', 'request_id': 'req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.650820 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5934bb7b7489440c96bd9c835c85eb2f', 'request_id': 'req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.663444 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] The token cache is being invalidate because project 5934bb7b7489440c96bd9c835c85eb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:01.663736 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.664504 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.666150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1379/2782] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:01 2022] DELETE /identity/v3/projects/5934bb7b7489440c96bd9c835c85eb2f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:01.672636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:01.685658 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdf474-3cfd-4677-b2a0-4e793f09d18d service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:01.752972 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:01.753920 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:01.754210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:01.754478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] PATH_INFO: `/v3/users/565008933ebd44e393ca7b583e396c3e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:01.755860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] RBAC: Authorizing `identity:delete_user(user_id=565008933ebd44e393ca7b583e396c3e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:01.757847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:01.809655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565008933ebd44e393ca7b583e396c3e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.818246 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565008933ebd44e393ca7b583e396c3e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.830403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565008933ebd44e393ca7b583e396c3e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.831100 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565008933ebd44e393ca7b583e396c3e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.836199 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:01.839483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-52013689-a09a-40cf-af64-5ab2299c984c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565008933ebd44e393ca7b583e396c3e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:01.847960 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1404/2783] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:01 2022] DELETE /identity/v3/users/565008933ebd44e393ca7b583e396c3e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:02.174182 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.175944 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:02.191807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bcc0-34c5-460b-8cde-f8ed8a2d3d68 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.258909 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.259907 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.260178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.260662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] PATH_INFO: `/v3/projects/3bee85ddb0ca41d99d44c5b17e718649` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.261908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bee85ddb0ca41d99d44c5b17e718649)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.264165 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.289087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:02.314591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bee85ddb0ca41d99d44c5b17e718649', 'request_id': 'req-40452399-cff3-4a8d-81c7-b6d7bb26671a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:02.321663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bee85ddb0ca41d99d44c5b17e718649', 'request_id': 'req-40452399-cff3-4a8d-81c7-b6d7bb26671a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:02.329839 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bee85ddb0ca41d99d44c5b17e718649', 'request_id': 'req-40452399-cff3-4a8d-81c7-b6d7bb26671a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:02.341661 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] The token cache is being invalidate because project 3bee85ddb0ca41d99d44c5b17e718649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:02.341972 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:02.342663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-40452399-cff3-4a8d-81c7-b6d7bb26671a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:02.344375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1380/2784] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:02 2022] DELETE /identity/v3/projects/3bee85ddb0ca41d99d44c5b17e718649 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:02.349467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.349962 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.350416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.370133 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:02.371414 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:02.439459 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1405/2785] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:02.448436 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.448723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.449001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.468389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:02.469536 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:02.478048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1381/2786] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:02.483115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.494292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9ce9-8d00-42e9-aad9-cf6fce08259e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.499716 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.500381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.500664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.500939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.501671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:02.502016 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.503671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.515538 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1406/2787] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:02.520270 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.530774 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316172c-fa20-41ee-9255-fe7af0be2986 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.537075 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.537749 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.538029 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.538303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.539015 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.540988 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.573712 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1382/2788] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:02.578055 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.590653 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e35a8-58e2-43e8-a02c-a56fbbd62914 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.648757 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.649458 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.649744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.650442 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.650708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.653024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.676632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1407/2789] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:02.681868 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.692847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16efe-90cc-4cf9-8464-7d463da7111a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.698190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.698850 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.699135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.699431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.700159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.701773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.714618 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1383/2790] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:02.719248 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.730455 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cbe0c-17ba-43aa-9309-5be5d9e153c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.735211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.735919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.736205 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.736484 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.737216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.738857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8034bb-c73f-4f4e-b518-0ae9476c2819 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.750111 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1408/2791] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:33:02.755760 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:02.766704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190598f-b309-4e55-a405-3c1d2f246ff4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:02.772477 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:02.773370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.773647 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.773918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] PATH_INFO: `/v3/projects/288944c051b0498ab6267473c5dad05a/users/2ba655d5ea8a428c90f8d2333142c132/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.791033 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=288944c051b0498ab6267473c5dad05a, user_id=2ba655d5ea8a428c90f8d2333142c132, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:02.793798 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:02.809485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1384/2792] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:02 2022] PUT /identity/v3/projects/288944c051b0498ab6267473c5dad05a/users/2ba655d5ea8a428c90f8d2333142c132/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:02.823779 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:02.824119 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:02.824492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:02.856868 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] MFA Rules not processed for user `2ba655d5ea8a428c90f8d2333142c132`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:02.858093 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:02.917118 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:02.943721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1409/2793] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:02.949167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.015813 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c466b-362b-4c5f-bd37-e0107bb1495e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.021139 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.021797 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.022921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.023202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.024625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.026908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.054725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1385/2794] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:02 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:03.059670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.073927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a75c4-3fb6-444d-9f00-ec5c8bfd0d04 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.140417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.141177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.141462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.141744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.142501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.144707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.168857 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1410/2795] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:03 2022] POST /identity/v3/users => generated 310 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:03.173757 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.185087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd934a3-d67a-46cf-837e-18acb72cc8e3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.190190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.190886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.191166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.191483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.192220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.193889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.205327 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1386/2796] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:03.209930 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.221436 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958609-b8e9-4b6f-8d4e-0ec46b03f0b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.227934 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.228935 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.229217 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.229495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] PATH_INFO: `/v3/projects/cef6df0ccff8496680c84d29b42e152a/users/ac11ef9ef0d64c21a9c520b06c839351/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.247536 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef6df0ccff8496680c84d29b42e152a, user_id=ac11ef9ef0d64c21a9c520b06c839351, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.250413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.268614 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1411/2797] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:03 2022] PUT /identity/v3/projects/cef6df0ccff8496680c84d29b42e152a/users/ac11ef9ef0d64c21a9c520b06c839351/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:03.274052 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.287223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd690-31b1-4a97-b90a-cd31c58f6af8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.309886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.310221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:03.312051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:03.360116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.360852 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.361135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.361414 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.362332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.364099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.375232 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1387/2798] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:03.379527 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.385537 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a307-14b5-4a73-80b7-69a439d4116a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.389998 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abcf59-6788-46b6-93dd-264d564163dd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.391020 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.391992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.392277 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.392588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] PATH_INFO: `/v3/users/f92eeb311c3347ceb4d42e7de40737ee` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.393997 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92eeb311c3347ceb4d42e7de40737ee)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.394723 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.395674 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.395959 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.396122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.396234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] PATH_INFO: `/v3/projects/cef6df0ccff8496680c84d29b42e152a/users/ac11ef9ef0d64c21a9c520b06c839351/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.398223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef6df0ccff8496680c84d29b42e152a, user_id=ac11ef9ef0d64c21a9c520b06c839351, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.400946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96aef0-c1fb-490f-8786-9c68bbb2d18e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.412202 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1388/2799] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:03 2022] PUT /identity/v3/projects/cef6df0ccff8496680c84d29b42e152a/users/ac11ef9ef0d64c21a9c520b06c839351/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:33:03.423191 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.423927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.424117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.449044 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92eeb311c3347ceb4d42e7de40737ee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:03.455567 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] MFA Rules not processed for user `ac11ef9ef0d64c21a9c520b06c839351`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:03.457694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:03.459052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92eeb311c3347ceb4d42e7de40737ee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:03.461670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:03.475330 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92eeb311c3347ceb4d42e7de40737ee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:03.476344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92eeb311c3347ceb4d42e7de40737ee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:03.485616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c8d214f1-0fe4-4050-b36f-3c4d53fbe245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92eeb311c3347ceb4d42e7de40737ee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:03.492501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1412/2800] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:03 2022] DELETE /identity/v3/users/f92eeb311c3347ceb4d42e7de40737ee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:03.497672 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.497992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.498264 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.517507 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:03.518847 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:03.547929 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1389/2801] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:03.560659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.562347 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:03.594070 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1413/2802] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:03.605767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.607416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:03.624106 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f3680-d898-43f3-9502-837f3b6a0828 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.669655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:03.676756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d67d5b-6ccc-4d69-b8bc-7ece2a05e1f3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.680422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.681029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.681159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.681411 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.681685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.681806 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.682004 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.682293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.692666 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.694257 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.704866 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1414/2803] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:33:03.744685 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:03.746214 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:03.756992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1390/2804] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:33:03.938361 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:03.949938 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6548a3-ed47-44f6-b7ea-21e76245ed5b service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:03.954191 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:03.954921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:03.955210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:03.955534 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:03.957568 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.010155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.012192 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.028240 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.028780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061e5b-d450-43a1-a74d-d6da9264d274 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.030058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f37f8-4c49-4f9a-b53d-d1b045ecccf2 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.034761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.035886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.036226 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.036595 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] PATH_INFO: `/v3/projects/41f530c802c1453cafa3d353337e2a57` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.037942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f530c802c1453cafa3d353337e2a57)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.040080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.043553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1415/2805] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:04.093344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f530c802c1453cafa3d353337e2a57', 'request_id': 'req-9b17cb30-194b-47a3-b75f-f106b5fa7798'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:04.107255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f530c802c1453cafa3d353337e2a57', 'request_id': 'req-9b17cb30-194b-47a3-b75f-f106b5fa7798'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:04.117413 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f530c802c1453cafa3d353337e2a57', 'request_id': 'req-9b17cb30-194b-47a3-b75f-f106b5fa7798'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:04.128449 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] The token cache is being invalidate because project 41f530c802c1453cafa3d353337e2a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:04.128734 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:04.129418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b17cb30-194b-47a3-b75f-f106b5fa7798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:04.131171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1391/2806] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:04 2022] DELETE /identity/v3/projects/41f530c802c1453cafa3d353337e2a57 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:33:04.138226 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.138551 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.138849 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.159767 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:04.161132 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.172344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:04.239140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1416/2807] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:04.251067 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.251422 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.251741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.271987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:04.273408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.283010 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1392/2808] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:04.287560 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.298790 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df457-ea19-4b1b-90ba-5c95f29746a1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.304578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.305230 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.305511 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.305814 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.306689 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:04.307002 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.308665 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.327031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1417/2809] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:04.328292 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.338931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73c69f-c965-4688-a51e-86eb1d051993 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.343701 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.344387 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.344659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.344981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.345718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.347927 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.381039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1393/2810] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:04 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:04.386028 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.396379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88279073-b586-4c90-b703-61be0c5cab7a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.469054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.470036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.470415 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.470717 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.471921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.474995 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.498190 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1418/2811] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:04 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:04.502680 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.523923 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eac2a-ca49-48b2-95b8-e94188c7c3f6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.534104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.534834 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.535116 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.535457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.537014 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.537950 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.551552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1394/2812] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:04.556354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.569861 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787b2f-3846-49ac-b127-9ddf1e648d6c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.576214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.576912 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.577214 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.577505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.578339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.580138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701fe80-a5e5-4dc0-8e3f-aa7947615d48 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.591966 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1419/2813] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:04.597196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.609028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75256-ce42-4c82-bede-d851575ddf90 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.615582 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.616617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.616904 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.617193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] PATH_INFO: `/v3/projects/dffa09eb93af40759014c66511db4120/users/10d0c1eb701c40f4918975146ace119c/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.639707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffa09eb93af40759014c66511db4120, user_id=10d0c1eb701c40f4918975146ace119c, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.643372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.660135 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1395/2814] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:04 2022] PUT /identity/v3/projects/dffa09eb93af40759014c66511db4120/users/10d0c1eb701c40f4918975146ace119c/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:33:04.671707 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.672033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.672310 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.704367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] MFA Rules not processed for user `10d0c1eb701c40f4918975146ace119c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:04.705630 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.785377 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1420/2815] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:04.800739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.802818 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:04.821535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:04.881176 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090be4-0cda-482f-adae-5533cb37475c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:04.885911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:04.886621 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:04.886908 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:04.887185 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:04.899883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:04.901447 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89d2b-f8eb-4fa4-9d52-cce42c531436 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:04.911887 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1396/2816] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:33:04.939744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:04.955492 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.018571 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc408-e6cb-4260-8f01-4973458fa693 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:05.023815 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:05.024752 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.025037 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.025314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] PATH_INFO: `/v3/users/10d0c1eb701c40f4918975146ace119c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.027345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d0c1eb701c40f4918975146ace119c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:05.028978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:05.085473 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d0c1eb701c40f4918975146ace119c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.095023 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d0c1eb701c40f4918975146ace119c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.109184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d0c1eb701c40f4918975146ace119c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.109940 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d0c1eb701c40f4918975146ace119c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.117919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d0c1eb701c40f4918975146ace119c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.124898 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1421/2817] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:04 2022] DELETE /identity/v3/users/10d0c1eb701c40f4918975146ace119c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:05.130502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.130791 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.131138 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.150933 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:05.152531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:05.222431 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1397/2818] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:05.233349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:05.234955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:05.338540 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349592-51cf-48e7-96d1-788c9671f58d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:05.344828 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:05.345955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.346425 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.346901 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.360380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:05.361872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99dd0f-0b13-460d-b7f0-1422db0861b6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:05.378404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1422/2819] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:05.672018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:05.673465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:05.688418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e8f1-6300-493a-84be-ef452d190983 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:05.694151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:05.694945 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.695120 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.695435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] PATH_INFO: `/v3/projects/dffa09eb93af40759014c66511db4120` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.696726 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffa09eb93af40759014c66511db4120)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:05.698649 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:05.754221 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffa09eb93af40759014c66511db4120', 'request_id': 'req-a83c8a53-d251-45be-891d-72a773682487'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.761953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffa09eb93af40759014c66511db4120', 'request_id': 'req-a83c8a53-d251-45be-891d-72a773682487'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.771303 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffa09eb93af40759014c66511db4120', 'request_id': 'req-a83c8a53-d251-45be-891d-72a773682487'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.787775 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] The token cache is being invalidate because project dffa09eb93af40759014c66511db4120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:05.788060 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.788739 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a83c8a53-d251-45be-891d-72a773682487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:05.790520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1398/2820] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:05 2022] DELETE /identity/v3/projects/dffa09eb93af40759014c66511db4120 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:05.795890 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.796409 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.796831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.819633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:05.821018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:05.831282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.889170 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1423/2821] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:05.897352 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.897639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.897915 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.918981 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:05.920282 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:05.928974 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1399/2822] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:05.933883 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:05.945126 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67006fc-dd20-402c-a02f-c7e817220154 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:05.950902 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:05.951618 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.951908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.952182 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.952961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:05.953263 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:05.954871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:05.968347 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1424/2823] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:05.973773 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:05.987208 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05703e0d-8aaf-44d0-99bb-db880faa086f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:05.992562 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:05.993253 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:05.993534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:05.993815 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:05.994575 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:05.996596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.025491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1400/2824] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:05 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:06.030913 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:06.043601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4af3c-edde-4bbf-a9ea-6849c515458d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:06.125980 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:06.126670 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.126955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.127235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.127969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:06.129924 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.161317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1425/2825] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:06 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:06.165917 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:06.177391 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56869-ad5f-4b62-b989-7b9917a2d11f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:06.182166 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:06.182833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.183115 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.183420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.184167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:06.185784 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.192164 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:06.201128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1401/2826] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:06.205360 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:06.216542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edb21-cda4-41b6-90e3-504ef5e5e67d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:06.222059 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:06.222751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.223041 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.223337 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.224086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:06.225744 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da557-e46e-4eb5-bb78-d907f1a6ef61 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.237150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1426/2827] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:06.242882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:06.254149 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f495-27c0-490a-892f-b55e3f503ed6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:06.263483 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:06.264497 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.264789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.265061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] PATH_INFO: `/v3/projects/70a59ca293cb4183a17926e94413a62f/users/f5d1433f9f90421080d00a85004ddc15/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.282155 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a59ca293cb4183a17926e94413a62f, user_id=f5d1433f9f90421080d00a85004ddc15, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:06.285001 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.300427 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1402/2828] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:06 2022] PUT /identity/v3/projects/70a59ca293cb4183a17926e94413a62f/users/f5d1433f9f90421080d00a85004ddc15/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:06.312645 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718efa-2eab-4916-99d7-55ef760b9a2f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.312928 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718efa-2eab-4916-99d7-55ef760b9a2f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.313211 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718efa-2eab-4916-99d7-55ef760b9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.348450 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1d718efa-2eab-4916-99d7-55ef760b9a2f None None] MFA Rules not processed for user `f5d1433f9f90421080d00a85004ddc15`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:06.349685 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d718efa-2eab-4916-99d7-55ef760b9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:06.418449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1427/2829] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:06.431441 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:06.433345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:06.495321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74a77-815b-46e5-85aa-31f7c24bae33 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:06.499934 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:06.500601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:06.500880 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:06.501150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:06.511177 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:06.512720 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:06.523580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1403/2830] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:08.007985 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:08.008584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:08.009150 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:08.033965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] MFA Rules not processed for user `f5d1433f9f90421080d00a85004ddc15`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:08.035353 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:08.044329 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1428/2831] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:09.381107 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.382556 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.486604 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5daca-e9a2-4c51-8990-af0f536d3157 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.492772 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.493488 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.493817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.494099 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.496399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.511665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.513395 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d98e0-ac7b-49a9-85c4-bcd3e4e48e0a service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.526074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1404/2832] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:09.569636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.571250 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.577198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:09.659916 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe2a2-ecac-4b95-a56a-bc45b792c772 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.665499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.666543 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.666820 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.667092 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] PATH_INFO: `/v3/users/2ba655d5ea8a428c90f8d2333142c132` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.668467 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba655d5ea8a428c90f8d2333142c132)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.670550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.729120 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba655d5ea8a428c90f8d2333142c132'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.737988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba655d5ea8a428c90f8d2333142c132'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.753526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba655d5ea8a428c90f8d2333142c132'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.754357 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba655d5ea8a428c90f8d2333142c132'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.764050 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba655d5ea8a428c90f8d2333142c132'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.770860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1429/2833] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:09 2022] DELETE /identity/v3/users/2ba655d5ea8a428c90f8d2333142c132 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:09.776204 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.776806 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.777104 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.797856 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:09.799203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.847505 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:09.863997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1405/2834] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:09.874462 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.876101 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.938700 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d304-7032-47c4-8925-84c5117cf69c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.943647 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.944350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.944626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.944884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.955573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.957168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.967921 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1430/2835] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:10.273580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:10.275384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:10.292240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2591905-1d9c-4b21-b0b0-a60c8570f1b7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:10.309457 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:10.318383 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:10.318644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:10.318921 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] PATH_INFO: `/v3/projects/288944c051b0498ab6267473c5dad05a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:10.320485 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=288944c051b0498ab6267473c5dad05a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:10.322690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:10.384386 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288944c051b0498ab6267473c5dad05a', 'request_id': 'req-5649f874-2ae1-4789-8eea-ddafd3824d6a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.393763 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288944c051b0498ab6267473c5dad05a', 'request_id': 'req-5649f874-2ae1-4789-8eea-ddafd3824d6a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.405639 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288944c051b0498ab6267473c5dad05a', 'request_id': 'req-5649f874-2ae1-4789-8eea-ddafd3824d6a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.420816 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] The token cache is being invalidate because project 288944c051b0498ab6267473c5dad05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:10.421189 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.423050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.424905 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1406/2836] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:10 2022] DELETE /identity/v3/projects/288944c051b0498ab6267473c5dad05a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:10.431096 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:10.442439 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3a45-8141-4d57-b28a-f99e5cb02779 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:10.468135 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:10.519157 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:10.520292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:10.520659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:10.520939 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] PATH_INFO: `/v3/users/ac11ef9ef0d64c21a9c520b06c839351` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:10.522397 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac11ef9ef0d64c21a9c520b06c839351)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:10.524509 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:10.584282 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac11ef9ef0d64c21a9c520b06c839351'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.593550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac11ef9ef0d64c21a9c520b06c839351'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.608865 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac11ef9ef0d64c21a9c520b06c839351'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.609708 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac11ef9ef0d64c21a9c520b06c839351'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.618275 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c87dd06-9340-4b3d-bf05-998ac463e116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac11ef9ef0d64c21a9c520b06c839351'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:10.625992 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1431/2837] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:10 2022] DELETE /identity/v3/users/ac11ef9ef0d64c21a9c520b06c839351 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:10.924012 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:10.927184 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:10.963758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f874-2ae1-4789-8eea-ddafd3824d6a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.040248 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.041266 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.041545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.041825 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] PATH_INFO: `/v3/projects/cef6df0ccff8496680c84d29b42e152a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.043239 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef6df0ccff8496680c84d29b42e152a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.045325 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.114162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef6df0ccff8496680c84d29b42e152a', 'request_id': 'req-71313328-8d64-4267-b498-efba425e2578'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:11.122147 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef6df0ccff8496680c84d29b42e152a', 'request_id': 'req-71313328-8d64-4267-b498-efba425e2578'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:11.131846 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef6df0ccff8496680c84d29b42e152a', 'request_id': 'req-71313328-8d64-4267-b498-efba425e2578'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:11.144651 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] The token cache is being invalidate because project cef6df0ccff8496680c84d29b42e152a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:11.144952 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:11.145718 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-71313328-8d64-4267-b498-efba425e2578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:11.147619 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1407/2838] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:10 2022] DELETE /identity/v3/projects/cef6df0ccff8496680c84d29b42e152a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:11.154354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.154654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.154943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.174906 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:11.176501 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:11.248076 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1432/2839] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:11.326741 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.327190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.327561 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.335063 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:11.353845 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:11.355146 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:11.365819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1408/2840] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:11.370654 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.381292 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f53d6-56b5-4319-bfd0-7d2e573f0b41 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.387181 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.387910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.388219 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.388542 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.389419 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:11.389721 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.391379 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.405223 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1433/2841] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:11.409707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.419931 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9921-5719-4797-81ef-82450d8ceca6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.427118 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.428021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.428375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.428807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.429511 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.431808 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.475792 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1409/2842] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:11 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:11.482424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.495457 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e34-4f5f-4cc5-9e79-6572fd05396a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.543802 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:11.588516 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.590001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.590289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.590927 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.592107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.594535 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.622463 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1434/2843] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:11 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:11.626992 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.641494 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52195b42-98b1-42d1-ae9f-f3b727c64ca7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.647159 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.648400 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.648895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.649529 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.650338 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.652420 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.665028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1410/2844] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:11.669611 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.680235 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce42821-6ca7-4df2-a64d-14b19975ae64 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.688099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.689015 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.689412 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.689822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.690749 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.692580 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f16c2f-3fcb-48d2-acd6-f8ba29a87330 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.707465 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1435/2845] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:11.708690 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.720663 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2811b-975f-4971-8284-af38a3008cd6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.730022 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.732467 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.732881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.734332 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] PATH_INFO: `/v3/projects/8fe91ba3f6b04cd88d3d45e4e362da98/users/65b6bb18232d417aa05529346e9a2100/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.754833 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe91ba3f6b04cd88d3d45e4e362da98, user_id=65b6bb18232d417aa05529346e9a2100, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.757659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:11.772682 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1411/2846] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:11 2022] PUT /identity/v3/projects/8fe91ba3f6b04cd88d3d45e4e362da98/users/65b6bb18232d417aa05529346e9a2100/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:11.783778 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08047b-2c95-4a94-9e8e-bc3ad7f2b1a8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.784074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08047b-2c95-4a94-9e8e-bc3ad7f2b1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.784359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08047b-2c95-4a94-9e8e-bc3ad7f2b1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.814034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3f08047b-2c95-4a94-9e8e-bc3ad7f2b1a8 None None] MFA Rules not processed for user `65b6bb18232d417aa05529346e9a2100`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:11.815373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3f08047b-2c95-4a94-9e8e-bc3ad7f2b1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:11.888176 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1436/2847] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:11.899892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:11.902289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:11.973173 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d922-403f-4d2e-a5d6-8768b5bb3d00 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:11.978267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c159e59080a41d2b1857c89c6e4c442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:11.979142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:11.979535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:11.979889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:11.991624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:11.994183 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:12.007704 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1412/2848] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:21.885142 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:22.002681 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:23.372584 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5205-954e-4f31-870a-b185aa1cbb19 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:23.373297 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5205-954e-4f31-870a-b185aa1cbb19 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:23.373476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5205-954e-4f31-870a-b185aa1cbb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:23.414845 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dafd5205-954e-4f31-870a-b185aa1cbb19 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:23.416051 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dafd5205-954e-4f31-870a-b185aa1cbb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:23.484344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1437/2849] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:33:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:23.542094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:23.543747 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:23.626641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288823ff-7c52-4e46-b512-55f75329f3d7 service glance] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:23.632140 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:23.632796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:23.633070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:23.633336 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:23.642698 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:23.644676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:23.654551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1413/2850] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:24.210713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d69ff-a127-4c5a-a90b-d4f3f1e7d1b9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:24.210969 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d69ff-a127-4c5a-a90b-d4f3f1e7d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:24.211244 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d69ff-a127-4c5a-a90b-d4f3f1e7d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:24.234659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e20d69ff-a127-4c5a-a90b-d4f3f1e7d1b9 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:24.235986 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e20d69ff-a127-4c5a-a90b-d4f3f1e7d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:24.244988 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1438/2851] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:24.262308 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:24.277100 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20161-ae9f-4d85-911f-290ea242667e service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:24.282644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:24.283300 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:24.283610 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:24.283882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:24.293103 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:24.294768 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:24.304700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1414/2852] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:24.542367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9eba3-3352-4d8c-b174-0c2cccecbbd0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:24.542999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9eba3-3352-4d8c-b174-0c2cccecbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:24.542999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9eba3-3352-4d8c-b174-0c2cccecbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:24.570572 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dbe9eba3-3352-4d8c-b174-0c2cccecbbd0 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:24.571904 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dbe9eba3-3352-4d8c-b174-0c2cccecbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:24.582259 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1439/2853] 10.222.0.82 () {58 vars in 1009 bytes} [Wed Jul 20 19:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:24.594844 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:24.606554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a9647-34e1-462e-ae1f-3c2385775349 service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:24.612552 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:24.613228 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:24.613503 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:24.613776 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:24.623564 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:24.625201 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:24.635617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1415/2854] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:24.984723 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:24.984978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:24.985276 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:25.008631 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:25.009841 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:25.017289 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1440/2855] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:25.030351 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:25.041330 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da706e-6908-4ce8-a527-68e433d8908f service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:25.046730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:25.047450 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:25.047740 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:25.048016 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:25.057728 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:25.059366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f6c43-49e8-4e82-9a7a-0793031ab87b service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:25.068796 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1416/2856] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:27.231522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:27.233024 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.304168 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372044b-05e4-4c9a-88d7-38318676242f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:27.309970 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:27.310863 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:27.311153 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:27.311461 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] PATH_INFO: `/v3/users/f5d1433f9f90421080d00a85004ddc15` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:27.312732 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d1433f9f90421080d00a85004ddc15)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:27.314673 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:27.370122 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d1433f9f90421080d00a85004ddc15'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.379512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d1433f9f90421080d00a85004ddc15'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.395526 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d1433f9f90421080d00a85004ddc15'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.396285 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d1433f9f90421080d00a85004ddc15'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.397495 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:27.405741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d1433f9f90421080d00a85004ddc15'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.413480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1441/2857] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:27 2022] DELETE /identity/v3/users/f5d1433f9f90421080d00a85004ddc15 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:27.418554 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:27.419048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:27.419162 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:27.437491 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:27.438711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.502799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1417/2858] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:27.514225 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:27.516317 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.582019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e486b-0e97-4aea-ae8e-b27496ce11ec admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:27.586354 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:27.587031 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:27.587339 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:27.587616 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:27.598074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:27.599553 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:27.610527 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1442/2859] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:33:27.840580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:27.842986 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.867659 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee570c5-802b-4483-940e-6d8dd6567cef None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:27.876340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:27.877223 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:27.877520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:27.877788 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] PATH_INFO: `/v3/projects/70a59ca293cb4183a17926e94413a62f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:27.879030 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a59ca293cb4183a17926e94413a62f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:27.881044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:27.950354 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:27.955609 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a59ca293cb4183a17926e94413a62f', 'request_id': 'req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.967229 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a59ca293cb4183a17926e94413a62f', 'request_id': 'req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:27.983625 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a59ca293cb4183a17926e94413a62f', 'request_id': 'req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:28.001384 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] The token cache is being invalidate because project 70a59ca293cb4183a17926e94413a62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:28.001588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:28.002724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9dc305a7-1bc7-40f7-aefd-86524e61b0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:28.011492 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1418/2860] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:27 2022] DELETE /identity/v3/projects/70a59ca293cb4183a17926e94413a62f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:35.099334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:35.101197 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:35.115215 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13250180-24b7-48bc-8562-f993817c53b3 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:35.180819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:35.181822 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:35.182114 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:35.182391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] PATH_INFO: `/v3/users/65b6bb18232d417aa05529346e9a2100` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:35.183671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b6bb18232d417aa05529346e9a2100)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:35.185643 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:35.246449 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b6bb18232d417aa05529346e9a2100'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.256919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b6bb18232d417aa05529346e9a2100'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.272029 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b6bb18232d417aa05529346e9a2100'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.272818 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b6bb18232d417aa05529346e9a2100'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.280722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b6bb18232d417aa05529346e9a2100'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.287172 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1443/2861] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:35 2022] DELETE /identity/v3/users/65b6bb18232d417aa05529346e9a2100 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:35.291902 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:35.292435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:35.292435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:35.310966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:35.312240 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:35.379819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1419/2862] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:35.390040 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:35.391693 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:35.407885 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:35.458824 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ccfb-0215-4eca-9e37-cdc7292d5bc4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:35.463121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:35.463831 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:35.464121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:35.464401 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:35.474766 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:35.476314 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78ebcb-a80e-452b-a993-56302c987ebf service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:35.487021 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1444/2863] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:35.794398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:35.795968 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:35.808942 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d48d0-8aea-4926-b254-7fc3821ed5a6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:35.816044 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:35.817557 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:35.818054 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:35.818496 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] PATH_INFO: `/v3/projects/8fe91ba3f6b04cd88d3d45e4e362da98` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:35.820655 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe91ba3f6b04cd88d3d45e4e362da98)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:35.824518 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:35.893940 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe91ba3f6b04cd88d3d45e4e362da98', 'request_id': 'req-a969390c-40b4-41c2-8057-c803ef161223'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.907070 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe91ba3f6b04cd88d3d45e4e362da98', 'request_id': 'req-a969390c-40b4-41c2-8057-c803ef161223'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.921160 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe91ba3f6b04cd88d3d45e4e362da98', 'request_id': 'req-a969390c-40b4-41c2-8057-c803ef161223'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.940895 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] The token cache is being invalidate because project 8fe91ba3f6b04cd88d3d45e4e362da98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:35.941569 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.942585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a969390c-40b4-41c2-8057-c803ef161223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:35.944939 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1420/2864] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:35 2022] DELETE /identity/v3/projects/8fe91ba3f6b04cd88d3d45e4e362da98 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:35.950499 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:35.951228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:35.951228 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:35.971517 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:35.972756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:36.041137 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1445/2865] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:36.052018 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.052480 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.052960 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.080368 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:36.082389 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:36.099406 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1421/2866] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:36.100835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.112498 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040e3a6-2eee-4774-9892-34dadb05f8e4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.117919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.118595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.118878 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.119210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.119953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:36.120293 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.122146 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.135999 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1446/2867] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:36.140677 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.151586 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c7bc8-c1fb-42a4-b081-3091b29c8708 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.158053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.158714 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.158990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.159255 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.159994 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.162036 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.196889 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1422/2868] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:36 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:36.198216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.211871 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166fdf-7f2b-457c-894f-4523f91f9e91 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.308201 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.308860 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.309242 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.309494 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.310301 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.313522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.338184 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1447/2869] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:36 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:33:36.342947 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.355440 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38f25-96e4-4cb2-b1c9-d86dc3895c76 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.361506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.362298 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.362641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.362997 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.363803 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.365725 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.378211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1423/2870] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:36.383035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.394320 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604945-397f-4ceb-951d-c99869d7ba99 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.399626 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.400380 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.400664 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.400937 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.402005 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.403681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572690-f767-48ce-aa3b-1b7eab275521 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.418817 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1448/2871] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:36.426039 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.443357 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cecb88-6aa9-4927-8988-ebe82df4e837 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.451151 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.452765 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.453235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.453703 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] PATH_INFO: `/v3/projects/599b9ecce6d049f19094b3ea56fc0cfe/users/2d145b17e2014542979743c35343d350/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.471426 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599b9ecce6d049f19094b3ea56fc0cfe, user_id=2d145b17e2014542979743c35343d350, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.474435 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.477218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:36.492126 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1424/2872] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:36 2022] PUT /identity/v3/projects/599b9ecce6d049f19094b3ea56fc0cfe/users/2d145b17e2014542979743c35343d350/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:36.504034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef629-c00c-493e-aaba-fb2e89cb798a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.504316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef629-c00c-493e-aaba-fb2e89cb798a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.504595 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef629-c00c-493e-aaba-fb2e89cb798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.537593 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-685ef629-c00c-493e-aaba-fb2e89cb798a None None] MFA Rules not processed for user `2d145b17e2014542979743c35343d350`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:36.538830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-685ef629-c00c-493e-aaba-fb2e89cb798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:36.548115 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:36.639910 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1449/2873] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:36.652916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:36.654932 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:36.756379 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118703-0ac5-4dcd-b9cf-abaf700a5163 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:36.760624 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bacfdb698cf41dfb6be9a0e94daf371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:36.761234 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:36.761591 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:36.761795 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:36.773876 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:36.775886 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:36.786310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1425/2874] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:38.552288 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:38.553052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:38.553052 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:38.574977 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] MFA Rules not processed for user `3df3d72eea444df9b8a8b945c3eb37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:38.576391 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:38.646236 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1450/2875] 10.222.0.82 () {58 vars in 967 bytes} [Wed Jul 20 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:38.660110 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:38.661914 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:38.773312 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7183-7168-4206-968b-c95e4aaf4d33 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:38.779366 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8731b43dcbb644a9abde1b4b30f5911e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:38.780041 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:38.780321 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:38.780601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:38.792789 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:38.794596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:38.810313 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1426/2876] 10.222.0.82 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:46.452741 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:46.454478 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:46.535359 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06887ab1-8dd5-4a9a-9053-679ca484c1e5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:46.540952 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:46.542036 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:46.542355 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:46.542636 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] PATH_INFO: `/v3/users/a64efc2ad0bb4bf58b221b2e62ae3676` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:46.544001 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64efc2ad0bb4bf58b221b2e62ae3676)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:46.546138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:46.595819 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64efc2ad0bb4bf58b221b2e62ae3676'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:46.604233 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64efc2ad0bb4bf58b221b2e62ae3676'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:46.606255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:46.618321 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64efc2ad0bb4bf58b221b2e62ae3676'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:46.619086 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64efc2ad0bb4bf58b221b2e62ae3676'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:46.626476 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64efc2ad0bb4bf58b221b2e62ae3676'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:46.632776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1451/2877] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:46 2022] DELETE /identity/v3/users/a64efc2ad0bb4bf58b221b2e62ae3676 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:46.821388 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:46.833980 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7c349-080a-4303-8161-77fdfbaee671 service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:47.045344 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:47.046220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.046551 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.046865 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] PATH_INFO: `/v3/projects/7698fac92732442a91d4bb085fc759b1` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.048220 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7698fac92732442a91d4bb085fc759b1)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:47.050334 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:47.059830 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:47.103827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7698fac92732442a91d4bb085fc759b1', 'request_id': 'req-56ac0641-8555-43e3-990c-f7cddd740b5f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.110531 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7698fac92732442a91d4bb085fc759b1', 'request_id': 'req-56ac0641-8555-43e3-990c-f7cddd740b5f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.120641 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7698fac92732442a91d4bb085fc759b1', 'request_id': 'req-56ac0641-8555-43e3-990c-f7cddd740b5f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.133847 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] The token cache is being invalidate because project 7698fac92732442a91d4bb085fc759b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:47.134128 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.134872 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.136827 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1427/2878] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:46 2022] DELETE /identity/v3/projects/7698fac92732442a91d4bb085fc759b1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:47.140619 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:47.142177 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:47.156405 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f195e2-75d1-43f8-9e88-f279b3e939a6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:47.218483 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:47.219487 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.219751 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.220026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] PATH_INFO: `/v3/users/7adca1f9351c41f083f5c942ea995d41` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.221404 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7adca1f9351c41f083f5c942ea995d41)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:47.223452 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:47.278600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7adca1f9351c41f083f5c942ea995d41'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.286116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7adca1f9351c41f083f5c942ea995d41'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.298316 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7adca1f9351c41f083f5c942ea995d41'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.298919 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7adca1f9351c41f083f5c942ea995d41'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.308915 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-063ae97a-0835-46ed-98b6-b3c94bb21d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7adca1f9351c41f083f5c942ea995d41'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.315579 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1452/2879] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:47 2022] DELETE /identity/v3/users/7adca1f9351c41f083f5c942ea995d41 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:47.528750 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:47.530289 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:47.550694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0641-8555-43e3-990c-f7cddd740b5f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:47.623570 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:47.624539 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.624817 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.625088 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] PATH_INFO: `/v3/projects/e5d8770ef1c34230834aeea31d5b0df6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.627065 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d8770ef1c34230834aeea31d5b0df6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:47.629326 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:47.683083 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d8770ef1c34230834aeea31d5b0df6', 'request_id': 'req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.692206 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d8770ef1c34230834aeea31d5b0df6', 'request_id': 'req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.700193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d8770ef1c34230834aeea31d5b0df6', 'request_id': 'req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.711502 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] The token cache is being invalidate because project e5d8770ef1c34230834aeea31d5b0df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:47.712028 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.712707 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f3d20cb4-8164-4f78-9a5b-fa58dd1885f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:47.714277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1428/2880] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:47 2022] DELETE /identity/v3/projects/e5d8770ef1c34230834aeea31d5b0df6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:47.719421 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.719953 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.720054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.739174 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:47.740443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:47.788195 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:47.803742 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1453/2881] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:47.869883 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.870535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.870535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.891842 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:47.893061 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:47.902203 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1429/2882] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:47.906381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:47.917607 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa50bc-5afe-479e-87ed-c5d765a8a5f7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:47.922578 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:47.923255 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.923600 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.923886 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.924648 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:47.924954 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:47.926656 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:47.939160 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1454/2883] 10.222.0.82 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:47.943644 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:47.953373 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76d8c-c7c8-4726-b93b-8d324d7ed9e9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:47.958617 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:47.959322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:47.959623 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:47.959870 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:47.960592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:47.962694 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:47.985069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:47.996093 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1430/2884] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:47 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:48.000621 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:48.013071 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01bed-37aa-4854-871a-43a48bbbb86b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:48.083418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:48.084054 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.084334 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.084601 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.085336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:48.087342 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:48.118344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1455/2885] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:47 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:48.123665 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:48.137370 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677522-f175-4abc-bc39-2b25e7144f2f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:48.142990 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:48.143764 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.144051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.144328 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.145124 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:48.146849 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:48.160050 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1431/2886] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:48.164771 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:48.176479 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca51b4e-5c04-4744-8d7a-e76048b45cc7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:48.183588 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:48.184381 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.184826 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.185099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.186058 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:48.188505 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad4d1-81a7-4b56-84e4-37050f295f81 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:48.200787 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1456/2887] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:33:48.205296 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:48.216277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ac378-8aab-4b6b-afad-45671f6c29d5 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:48.221374 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:48.222322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.222724 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.222987 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] PATH_INFO: `/v3/projects/95fe5a006f5d4124bf5eae619d9700aa/users/f9e537079ac54a198eec2ceedaacdcbf/roles/401c11587dd645d8a09a0c7acb2df8c2` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.239078 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fe5a006f5d4124bf5eae619d9700aa, user_id=f9e537079ac54a198eec2ceedaacdcbf, role_id=401c11587dd645d8a09a0c7acb2df8c2)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:48.241801 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:48.259911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1432/2888] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:48 2022] PUT /identity/v3/projects/95fe5a006f5d4124bf5eae619d9700aa/users/f9e537079ac54a198eec2ceedaacdcbf/roles/401c11587dd645d8a09a0c7acb2df8c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:48.265434 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05584-9370-47af-aaf0-6f28e511e85d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.265722 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05584-9370-47af-aaf0-6f28e511e85d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.265993 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05584-9370-47af-aaf0-6f28e511e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.285897 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e7e05584-9370-47af-aaf0-6f28e511e85d None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:48.287148 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e7e05584-9370-47af-aaf0-6f28e511e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:48.356947 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1457/2889] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:48.367353 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:48.369243 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:48.440051 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86f1c-0f0d-413f-9d02-186ddd29d02a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:48.444224 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:48.444916 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:48.445193 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:48.445459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:48.455911 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:48.457442 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:48.469310 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1433/2890] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:52.754520 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:52.755169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:52.755169 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:52.822322 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] MFA Rules not processed for user `f9e537079ac54a198eec2ceedaacdcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:52.823936 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:52.887057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:52.912563 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1458/2891] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:52.919021 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:52.930167 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece40b-afa0-4217-9f9e-b49eeb82d0d4 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:52.935268 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:52.935984 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:52.936267 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:52.936535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:52.937258 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:52.939211 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:52.969277 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1434/2892] 10.222.0.82 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:52 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:33:52.974019 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:52.992884 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b306e8-a9d2-48ca-b924-e9912e947a8d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:53.078416 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:53.079238 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:53.079634 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:53.079917 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:53.080756 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:53.083270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:53.113034 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1459/2893] 10.222.0.82 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:52 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:33:53.117331 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:53.128920 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9720e-f622-4241-9ddc-b7c3714b98a8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:53.136212 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:53.137418 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:53.137892 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:53.138171 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:53.139235 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:53.141912 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:53.155676 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1435/2894] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:33:53.160286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:53.174138 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d755a-13aa-4f6e-8d48-3d3d6d50b7e1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:53.180151 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:53.181098 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:53.181382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:53.181661 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] PATH_INFO: `/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7/users/242f0ad4e1504c4eacbebb4853097c58/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:53.198655 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe12bd96807c4205a39dca1eaaf9cae7, user_id=242f0ad4e1504c4eacbebb4853097c58, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:53.201784 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:53.218109 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1460/2895] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:53 2022] PUT /identity/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7/users/242f0ad4e1504c4eacbebb4853097c58/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:53.222399 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:53.234283 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c44d-9e67-4ca0-9f6c-fed5a2a1ee95 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:53.297320 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:53.298013 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:53.298299 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:53.298572 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:53.299408 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:53.301024 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c296b8a-9466-4952-a9f2-73c684688b50 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:53.312731 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1436/2896] 10.222.0.82 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:53.317198 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:53.328274 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597031c-427e-45eb-a439-ddd406c6770f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:53.332931 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:53.333830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:53.334107 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:53.334417 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] PATH_INFO: `/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7/users/242f0ad4e1504c4eacbebb4853097c58/roles/c3b9dae1beda4ff3b7b79942b90621e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:53.336386 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe12bd96807c4205a39dca1eaaf9cae7, user_id=242f0ad4e1504c4eacbebb4853097c58, role_id=c3b9dae1beda4ff3b7b79942b90621e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:53.339113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:53.353349 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1461/2897] 10.222.0.82 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:53 2022] PUT /identity/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7/users/242f0ad4e1504c4eacbebb4853097c58/roles/c3b9dae1beda4ff3b7b79942b90621e0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:58.694762 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad088d4-68cd-49c0-bcd4-dcc8f459afd9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:58.695367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad088d4-68cd-49c0-bcd4-dcc8f459afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:58.695367 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad088d4-68cd-49c0-bcd4-dcc8f459afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:58.739333 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3ad088d4-68cd-49c0-bcd4-dcc8f459afd9 None None] MFA Rules not processed for user `242f0ad4e1504c4eacbebb4853097c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:58.740854 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3ad088d4-68cd-49c0-bcd4-dcc8f459afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:58.761967 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:58.820034 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1437/2898] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:58.835998 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:58.838175 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:58.941413 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6db52-cc72-4b0a-8cf1-b6ec95a1fdaf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:58.947348 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:58.948116 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:58.948403 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:58.948681 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:58.967207 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:59.015830 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:59.020390 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:59.031805 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1462/2899] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:00.118465 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7659e-cc9b-488b-a779-4bfd86b7d1d7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:00.118999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7659e-cc9b-488b-a779-4bfd86b7d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:00.118999 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7659e-cc9b-488b-a779-4bfd86b7d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:00.140778 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5dd7659e-cc9b-488b-a779-4bfd86b7d1d7 None None] MFA Rules not processed for user `f9e537079ac54a198eec2ceedaacdcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:00.142190 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5dd7659e-cc9b-488b-a779-4bfd86b7d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:00.150053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1438/2900] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:07.518060 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:07.520287 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:07.638323 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddcb36-22bd-4b28-be8b-5a8a79d3ae80 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:07.644350 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:07.645286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:07.645565 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:07.645835 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] PATH_INFO: `/v3/users/2d145b17e2014542979743c35343d350` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:07.647522 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d145b17e2014542979743c35343d350)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:07.649480 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:07.720961 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d145b17e2014542979743c35343d350'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:07.730791 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d145b17e2014542979743c35343d350'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:07.755671 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d145b17e2014542979743c35343d350'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:07.756965 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d145b17e2014542979743c35343d350'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:07.770475 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d145b17e2014542979743c35343d350'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:07.782729 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1463/2901] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:07 2022] DELETE /identity/v3/users/2d145b17e2014542979743c35343d350 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:07.794918 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:07.795579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:07.795579 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:07.815631 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] MFA Rules not processed for user `ee75234fc7604aa08cbc0948f9b33ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:07.816896 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:07.884066 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1439/2902] 10.222.0.82 () {58 vars in 957 bytes} [Wed Jul 20 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:07.896650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:07.899290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:07.950529 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:07.974013 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859d5d8-882e-42ec-b85e-7baff4637cd4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:07.978726 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:07.979411 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:07.979706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:07.979978 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:07.992504 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:07.994030 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:08.007210 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1464/2903] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:08.371438 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:08.373977 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:08.387700 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4ab3-166a-4f49-a621-929c6ec616e2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:08.392489 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:08.393398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:08.393673 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:08.394084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] PATH_INFO: `/v3/projects/599b9ecce6d049f19094b3ea56fc0cfe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:08.395614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599b9ecce6d049f19094b3ea56fc0cfe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:08.397585 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:08.450053 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599b9ecce6d049f19094b3ea56fc0cfe', 'request_id': 'req-0f16fce4-1f3b-46bf-a385-d733ba01c596'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:08.456293 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599b9ecce6d049f19094b3ea56fc0cfe', 'request_id': 'req-0f16fce4-1f3b-46bf-a385-d733ba01c596'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:08.464871 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599b9ecce6d049f19094b3ea56fc0cfe', 'request_id': 'req-0f16fce4-1f3b-46bf-a385-d733ba01c596'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:08.477097 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] The token cache is being invalidate because project 599b9ecce6d049f19094b3ea56fc0cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:08.477459 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:08.478215 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:08.480048 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1440/2904] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:08 2022] DELETE /identity/v3/projects/599b9ecce6d049f19094b3ea56fc0cfe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:18.001256 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=9 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:18.472549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:24.798725 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:24.808696 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512990c2-0579-4cc3-9cab-092d82d13809 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:24.869799 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:24.870460 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:24.870747 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:24.871026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:24.873113 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:24.949298 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:24.950776 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:24.961074 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1465/2905] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:34.956216 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=50 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:58.905398 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:58.907470 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:58.922966 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16fce4-1f3b-46bf-a385-d733ba01c596 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:58.927453 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:58.928109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:58.928392 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:58.928668 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:58.930687 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:58.941117 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:58.942580 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:58.951094 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1441/2906] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:08.947385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=6 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:22.132506 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.134437 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.150688 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce509b-eb4d-4d63-95d9-5a01203c875d service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.155727 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.156385 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.156668 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.156943 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.159130 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.235733 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.237108 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.248667 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1466/2907] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:23.448635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.458545 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d344f6-1566-49ea-826b-c115dacefee9 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.463348 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.464196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.464522 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.464807 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.467084 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:23.483158 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.484635 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.496588 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1442/2908] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:32.243345 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=34 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:33.491069 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=6 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:35.588811 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.598305 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9e7d-a3be-45a6-9fa0-59a480584953 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.603186 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.604340 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.604632 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.604905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.606891 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.618026 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.619679 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.633336 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1467/2909] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:35.737520 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.747188 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78720b-c77b-499a-a908-cec53ff79969 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.751372 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e626b6c267034377a800d89dd1a40bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.752345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.752614 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.753074 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.755375 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.770900 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.772601 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.790076 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1443/2910] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:35.857424 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.858955 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.941650 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fd9c2-4868-486c-9657-bcf8b49ba945 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.950123 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.950777 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.951078 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.951382 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.953524 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.967079 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.968775 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.979754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1468/2911] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:39.247549 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.249711 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.266540 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa23-d3d2-474b-a553-a1830b452eb1 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.273315 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.274672 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.274953 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.275506 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.278011 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.291662 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.293863 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.306109 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1444/2912] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:45.975145 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=38 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:49.301005 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=12 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:53.762218 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:53.765033 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:53.785099 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bfd58-dc50-4f8d-ad9f-8bbeccad2de3 service placement] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:53.793286 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9ee3d95d2549159195ce82240f16ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:53.794396 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:53.794872 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:53.795367 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:53.797384 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:53.813035 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:53.815646 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:53.830719 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1469/2913] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:00.894615 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:00.907133 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae2ca-cb4c-4805-b5a5-2da0ae091f31 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:00.913322 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:00.914081 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:00.914362 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:00.914596 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:00.918142 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:00.938533 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:00.940462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:00.954608 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1445/2914] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:03.823627 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:03.978018 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:04.002706 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab3bff-0cdc-473c-8f61-acdd26d5e6a2 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:04.012599 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:04.013713 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:04.014399 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:04.015121 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:04.026418 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:04.042512 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:04.043447 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:04.053606 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:04.055881 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:04.057905 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1470/2915] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:04.126378 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc28bad-fdf8-48e5-ad6d-3bf195baa910 service placement] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:04.131799 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:04.132819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:04.133218 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:04.133498 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] PATH_INFO: `/v3/users/f9e537079ac54a198eec2ceedaacdcbf` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:04.134730 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e537079ac54a198eec2ceedaacdcbf)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:04.136780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:04.197879 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e537079ac54a198eec2ceedaacdcbf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.207930 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e537079ac54a198eec2ceedaacdcbf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.220735 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e537079ac54a198eec2ceedaacdcbf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.221409 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e537079ac54a198eec2ceedaacdcbf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.222150 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e537079ac54a198eec2ceedaacdcbf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.241304 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1446/2916] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:04 2022] DELETE /identity/v3/users/f9e537079ac54a198eec2ceedaacdcbf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:04.437843 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:04.449550 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa411b-54f4-42fc-8c52-c717c2b42877 service placement] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:04.507754 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:04.508629 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:04.508911 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:04.509187 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] PATH_INFO: `/v3/projects/95fe5a006f5d4124bf5eae619d9700aa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:04.510373 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fe5a006f5d4124bf5eae619d9700aa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:04.512344 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:04.563068 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fe5a006f5d4124bf5eae619d9700aa', 'request_id': 'req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.571290 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fe5a006f5d4124bf5eae619d9700aa', 'request_id': 'req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.578140 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fe5a006f5d4124bf5eae619d9700aa', 'request_id': 'req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.589279 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] The token cache is being invalidate because project 95fe5a006f5d4124bf5eae619d9700aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:04.589573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.590304 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.592270 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1471/2917] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:04 2022] DELETE /identity/v3/projects/95fe5a006f5d4124bf5eae619d9700aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:04.596196 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:04.597710 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:04.611970 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f1-cec7-4e3e-9b3d-87fe1cb8256d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:04.678578 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:04.679534 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:04.679811 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:04.680080 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] PATH_INFO: `/v3/users/242f0ad4e1504c4eacbebb4853097c58` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:04.681340 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=242f0ad4e1504c4eacbebb4853097c58)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:04.683345 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:04.689592 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:04.749178 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242f0ad4e1504c4eacbebb4853097c58'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.757780 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242f0ad4e1504c4eacbebb4853097c58'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.767462 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242f0ad4e1504c4eacbebb4853097c58'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.768089 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242f0ad4e1504c4eacbebb4853097c58'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.768758 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242f0ad4e1504c4eacbebb4853097c58'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:04.787517 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1447/2918] 10.222.0.82 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:04 2022] DELETE /identity/v3/users/242f0ad4e1504c4eacbebb4853097c58 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:04.987944 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:04.989556 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:05.003017 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ecb1c-ee46-4018-be88-c19fb2ffc70c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:05.069456 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee75234fc7604aa08cbc0948f9b33ca5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8244e79834fb42488dc5fd64702925b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:05.070351 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:05.070633 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:05.070908 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] PATH_INFO: `/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:05.072131 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe12bd96807c4205a39dca1eaaf9cae7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:05.074057 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:05.095659 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:05.124946 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe12bd96807c4205a39dca1eaaf9cae7', 'request_id': 'req-fe9288e7-b049-4677-955a-32c51ca3ead6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:05.133768 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe12bd96807c4205a39dca1eaaf9cae7', 'request_id': 'req-fe9288e7-b049-4677-955a-32c51ca3ead6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:05.140573 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe12bd96807c4205a39dca1eaaf9cae7', 'request_id': 'req-fe9288e7-b049-4677-955a-32c51ca3ead6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:05.151846 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] The token cache is being invalidate because project fe12bd96807c4205a39dca1eaaf9cae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:05.152134 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:05.152840 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe9288e7-b049-4677-955a-32c51ca3ead6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:05.154443 dv-cinder-850548-1-smb devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1472/2919] 10.222.0.82 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:04 2022] DELETE /identity/v3/projects/fe12bd96807c4205a39dca1eaaf9cae7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:14.783761 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:15.148711 dv-cinder-850548-1-smb devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:08.186946 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:08.189087 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:08.268484 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b7802-8e8c-4d88-9d47-8cfbe6b7fbbc admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:08.331882 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e20517c584bc0bd7df627d805467b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d0399f14a24c259888e0c8df1f3fdf', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:08.332535 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:08.332819 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:08.333092 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:08.334938 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:08.347650 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:08.349278 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03219a3-5fe2-4cab-803f-cff9619df14f service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:08.360000 dv-cinder-850548-1-smb devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1448/2920] 10.222.0.82 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:18.355385 dv-cinder-850548-1-smb devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=58 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}